SOME RESULTS ON THE LARGE TIME BEHAVIOR OF WEAKLY 
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VINH DUC NGUYEN 

Abstract. Systems of Hamilton- Jacobi equations arise naturally when we study the optimal 
control problems with pathwise deterministic trajectories with random switching. In this 
work, we are interested in the large time behavior of weakly coupled systems of first-order 
I Hamilton- Jacobi equations in the periodic setting. The large time behavior for systems of 

Hamilton- Jacobi equations have been obtained by Camilli-Loreti-Ley and the author (2012) 
and Mitake-Tran (2012) under quite strict conditions. In this work, we use a PDE approach 
to extend the convergence result proved by Barles-Souganidis (2000) in the scalar case. This 
general result permits us to treat lot of general cases, for instance, systems with nonconvex 
Hamiltonians and systems with strictly convex Hamiltonians. We also obtain some other 
convergence results under different assumptions, these results give a clearer view on the 
large time behavior for systems of Hamilton- Jacobi equations. 
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1. Introduction 

1.1. Statement of the problem and recalls of the results for single equations. In 

this paper, we study the large time behavior of systems of Hamilton-Jacobi equations 



d m 

-^+H i (x,Du i ) + Y,d ij (x)u j =0 (x,t) G x (0, +oo), 
k Ui(x,0) = Uot(x) x 6 T^, 



(1.1) 

where is the iV-dimensional torus, the coupling is linear and monotone, i.e., 
(1.2) 



dij : — > R are continuous and, for all x € T , 



du(x) > 0, dij{x) < for i 7^ j and dij(x) = for all i 



and 



Hi G C(T JV x R N ), u 0i G C(T N ), i = l,...,m. 



The aim of this work is to improve the first results obtained by Camilli-Ley-Loreti and the 
author [6] and Mitake-Tran [22] and, more generally, to generalize to systems of the form (jl.ip . 
the existing results for the case of a single Hamilton-Jacobi equation 



^ + H{x,Du) = 0, (x, t) G T N x (0, +00), 
u(x,0) = uq(x) x G T^. 



(1.3) 

Let us start by recalling the existing results for (jl.3p . The large time behavior has been 
extensively investigated using both PDE methods and dynamical approaches. The desired 
result is that to find a unique constant c G M, the so-called critical value or ergodic constant, 
and a solution v of the stationary equation 

(1.4) H(x,Dv) = c mR N 
such that 

(1.5) u(x,t) + ct v(x) uniformly as t tends to infinity. 

The first results are of Fathi jlO] and Namah-Roquejoffre [25j where the convexity of Hamil- 
tonians plays a key role. The result of |10| was proved, in a periodic setting, under the as- 
sumption that H is uniformly convex with respect to p, i.e., there exists a constant a > 
such that 

(1.6) D 2 pp H(x,p) > al, for all (x,p) £T N x R N . 

This result was extended to general strictly convex Hamiltonians in Davini-Siconolfi [8]. We 
say that a Hamiltonian H(x,p) is strictly convex when, for any x G T^, 

H(x, Xp + (1 - X)q) < XH(x,p) + (1 - X)H(x, q) for any < A < 1, p ^ q. 



In [25], the result was proved for Hamiltonians of the form 

H(x,p) = F(x,p) - f(x), with F(x,p) > F(x,0) =0, / > 0, 
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F G C(T N x W N ), f G C(T N ) and F is coercive and convex with respect to p. In this 
framework, the set 

F SC alar = {xq G : f(x ) = 0}, 

which is assumed to be nonempty, plays a crucial role. It appears to be a uniqueness set for 
the stationary equation (jl.4p . i.e., the solution of (|1.4|) is uniquely characterized by its value 
on this set. The idea of |25) is to prove first the convergence of u(-,t) as t —± +00 on this set 
Fgcaiar and then, to obtain the convergence everywhere by using the limit values of u(-,t) on 
J- SC aiar as Dirichlet boundary conditions for (ll.4p . 

Barles and Souganidis [4] succeeded in relaxing a bit the convexity condition on H. Under 
suitable sets of assumptions, which include the cases of [101 125] . they obtain the conver- 
gence (jl.5p . We state a result of [I] we will be interested in. We assume that (jl.4p is solved 
for c = and we introduce the assumptions on H (in general, the assumptions are made on 
H-c) 

(i) The function p t— > H(x,p) is differentiable a.e. in x G T , 
, „n (ii) There exists a, possibly empty, compact set K of such that: 
^ ' I (a) H(x,p) > on K x R N , 

(b) If H(x,p) > 77 > and d(x,K) > 77, then H p (x,p)p - H(x,p) > ^(rj) > 0. 

If K = 0, we define d(x, ET) = +00 for any x G T N . 

Theorem 1.1. (@]) Assume that H G C(T jV x 1^) and (fT7|) Zio/t/s. T/ien ; any solution 
u G W 1 . 00 ^ x (0,oo)) of (JOJ) converges uniformly to a solution v G VF 1 ' 00 ^) 0/ (fL4|) . 

In this work, we are mainly concerned in extending the previous results to systems. Let us 
mention Fathi [11], Roquejoffre [26] for other related results in the periodic setting. Some of 
these results have been also extended beyond the periodic setting, see Barles and Roquejoffre 
[3], Ishii [16], Ichihara and Ishii [JJ], and for problems with periodic boundary conditions, see 
for instance Mitake [201 1191 f2Tj . We refer also the reader to Ishii [15} 117] for an overview. 

In the case of systems, we are interested in finding an ergodic constant vector (ci, . . . , c m ) G 
W 71 and a function {v 1, . . . , v m ) such that 

m 

(1.8) Hj(x, Dvj) + djj{x)vj = Oj, x G T N , i = l,...,m 

3=1 

and, for all i = 1, . . . , m, 

(1.9) Ui(x,t) + Cji — > Uj(x) uniformly as t tends to infinity, 

where u is the solution of (II. ip . 

First results for the system (|l.ip were obtained in [6] and [22]. More precisely, suppose 
that Hi(x,p) = Fi(x,p) — fi(x) satisfies the same properties as in [25] (see above and (11.391) ). 
Assume that 

(1.10) T = {x &T N : fi(x ) = min^iv fj(x) for all i,j = 1, . . . ,m} / 0, 

i.e., the fi 's attain their minimum at the same point with the same value. They prove that F 
is a uniqueness set (which replaces F sca iar)- Then, the proof of the convergence is obtained. 
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It is based on the same ideas as in [25]. Let us outline the proof of convergence of [6]. To 
simplify, assume that 

m m 

(1.11) J2d ij (x) = 0, ^e%(x) = 0, i,j = l,...,m, x€T N . 
j=i i=i 

Without loss of generality, we suppose that /j(xo) = where xq 6 T defined in (|1.10p . The 
coercivity of the Hamiltonians and the existence of a solution to the ergodic problem give the 
compactness of the sets {ui(.,t), t > 0}'s in W 1,oc (T N ) (under the assumption (jl.lOp and 
fi(xo) = for xq € T, we obtain (ci, . . . , c m ) = (0, . . . , 0)). By summing the equations (jl.ip 
for i = 1, . . . , m, one obtains 

m q m m 

i=l i=l =1 

Using (jl.lip and Hi(x, Dui) > on J, one gets easily that 

d m 

(1.12) Q- t Y. u ^ x ^ ^° onJ7 

i=l 

and therefore t h-> {u\ + • • • + u m )(-,t) is nonincreasing and converges uniformly as t — > +oo 
on T . From this fact, one can prove the convergence of each U{ on T . Using that J 7 is a 
uniqueness set, (jl.8p has a unique solution if one prescribes the values of v^s on (jl.8p . This 
is enough to conclude the convergence (II. 9p in all T . 

The interest of studying this kind of systems relies on the nice control interpretation they 
have. They are related to optimal control of pathwise deterministic trajectories with random 
switching (see [61 Section 6] and the Appendix for details). When the /j's achieve their 
minimum at the same points with the same value , i.e., when T ^ 0, the interpretation of 
the convergence result in terms of control is clear: one should rather driving the trajectories 
to a common minimum of the /j's since these latters play the role of the running costs of the 
control problem. 

The extension of such a result to the case T = 0, i.e, when the /j's do not have common 
minimum with the same value, was the most challenging issue which was addressed in [6j 
and one of the motivation of this paper. The following example shows the main difficulty we 
encounter. 



Example 1.2. 



^ + \Du 1 \ 2 + u 1 -u 2 = h(x), 
^ + \Du 2 \ 2 + u 2 - ui = h{x) 



at 

In this example, we choose fi(x) = cos 2 x + sinx — cosx, /2(x) = sin 2 x + cosx — sinx. We 
have 

min fi = min f 2 := m < and /i(x) + f 2 {x) = 1. 

The last equality shows that f\, f 2 do not attain their minima at the same point so J- = 0. 
Assume that (wi,w 2 ) 6 C(R) x C(M) is a solution of 

{\Dwi\ 2 + w\ — w 2 = cos 2 x + sinx — cosx, 
\Dw 2 \ + w 2 — w± = sin x + cosx — sinx, 



LARGE TIME BEHAVIOR OF WEAKLY COUPLED SYSTEMS 5 

Such a solution clearly exists since we can take (w\,W2) = (sin(.), cos(.)). Then the ergodic 
constant in this example is 0. 

Summing the equations of System (| 1 . 13[) . we have 

^±^ + \Du^ + \Du^ = l. 

It follows that we cannot find any set where (|1 . 12[) holds and the proof of [6] and [22] does 
not work anymore. 

However, and it is one of the main achievement of this paper, we will see below how our 
main result Theorem 11.41 can be applied to give a full answer to this problem, see Theorem 
11.51 Moreover, we can improve directly the result of [221 IS], in a particular case, see Theorem 
11.61 For a comparison of these two new results, see Section 11.51 



1.2. Main result. In this section, the existence of solutions to the stationary system fll .8 j) is 
made as an assumption and we will normalize the Hamiltonians so that the ergodic constant 
(ci, . . . , c m ) = (0, . . . , 0). So we introduce the assumptions on Hi (in general, the assumptions 
are made on Hi — q) 

The main result of this work is the extension of Theorem 11.11 to the system (jl.ip . In order 
to explain the difficulty of this extension, we start by giving a rough idea of the proof of 
Theorem 11.11 

In [1], the authors first show that 

du 

(1.15) min — (x,t) — > as t tends to infinity. 

x£T N dt 

The main consequence of this fact is that the w-limit set of {u(.,t), t > 0} constains only 
subsolutions of (|1.4p . This fact with the compactness of are enough to prove (|1.5p . 
Now to prove (|1.15p . the authors perform a change of function of the form 

(1.16) exp(u;(x, t)) = u(x, t), (x, t) eT N x (0, oo). 

Then w solves 
dw 

(1.17) -7^- + F(x, w, Dw) = 0, with F(x, w,p) = exp(—w)H(x, exp(w)p) 

and F inherits the properties of H: 

{There exists a, possibly empty, compact set K, of such that 
if F(x,w,p) > rj > and d(x,JC) > r], then F w (x,w,p) > ^(rj) > a.e. 



(1.18) 



An application of the maximum principle yields that t i-> min^^jjv ^r(x,t) is nonincreasing 
so it converges. If the limit is nonnegative, we obtain easily the convergence of w(x,t) as 
t — > oo. Otherwise, there exists some rj > 0, to > such that for all £ > i 

dw , 

1.19) min ^-(x,t) < -n. 

Set z = ^ and m(t) = min^iv z(x,t) := z(xt,t). Differentiating (|1.17p with respect to t, 
we obtain 

dz 

— + F w (x, w, t, Dw)z + F p .Dz = 0. 
dt 
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Formally at x t , we get 

m + F w (xt,w, t, Dw)m = 0. 
Using (fTTgj) and (TO?]) , we get 

rri + ^(r/)m > 0, thus m(t) > m(t )e" ,I ' (r ' ){< ~' o) 
Letting t tends to infinity yields a contradiction with (|1.19p . 

Now, let us turn to the case of systems through the typical example 

f dg j L + H 1 (x,Dui) + u 1 -u 2 = 0, 

\ (sc.t) Gl^ x (0,+oc), 

I ^ + #2<>, Du 2 ) + u 2 - ui = 0, 

where the H^s satisfy (jl.7p . Similarly to the case of a single equation, if we perform the 
change of function exp(wj) = Uj, then we obtain the new system 

(1.20) \ (x,t) GT W x (0,+oo), 
1 ^ + F 2 (x,w 2 ,Dw 2 ) + l-exp(w 1 -w 2 ) = 0, 

where Fi(x,w,p) = exp(—w)Hi(x,exp(w)p). Let us try to mimic the above sketch of proof 
in the case of the system (|1.20p . We want to prove that 

(1.21) min — — (x,t) — > as t tends to infinity. 

xeT^, t=i,2 at 

An application of the maximum principle yields that t \— > min^g^jv^ i=12 ^fj~{ x i~t) ls non- 
increasing so it converges. If the limit is nonnegative, we obtain easily the convergence of 
Wi(x, t) as t — > oo. Otherwise, there exists some 77 > 0, to > such that for all t > to 

(1.22) min —L( Xl t)<—q. 

xGT N , i=l,2 at 

Set Z{ = and assume that 

(1.23) m(t) = min zdx, t) := z±(xt, t). 

x£T N , t=l,2 

This fact, (fL20D and (1021) only give 

(1.24) F 1 (x t ,wi,Dw 1 ) + 1 - exp(w 2 - wi)(x t ,t) > rj. 

We see that (|1.18p cannot apply here, since we cannot control the additional term 1— exp(zz; 2 — 
wi)(xt,t) using only the information given by (jl.23p . 

It forces us to modify the assumptions of Theorem 11.11 to be able to treat this difficulty. 
The new assumption should encompass typical Hamiltonians which satisfy the assumptions 
of Theorem II .li We propose two sets of assumptions. 

The following set of assumptions seems to be the natural extension of (|1.7p to systems. We 
assume for i = 1, . . . , m that 

(i) The function p i-> Hi(x,p) is differentiable a.e. in x G T^. 



[1.25) 



(ii) (Hi) p p - Hi >0 for a.e. (x,p) £T N x R N , 

(Hi) There exists a, possibly empty, compact set K of T N such that 
(a) Hi(x,p) > on K x 1^ , 

(6) If Hi(x,p) > i] > and d(x, K) > rj, then (Hi) p p - Hi > (77) > 0. 
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Comparing (jl,25p in the case of a single equation (m = 1) and (|1.7p . we see that (|1.25p 
(ii) is the only additional assumption, which is crucial in the proof of (11.290 (see the key 
Lemma I6.2|) . 

Here is another set of assumptions which is not covered by (jl.25p . 

(i) The function p i— >• Hi(x,p) is differentiable a.e. in x G for all i. 

(ii) (Hi) p p - Hi > for a.e. (x,p) eT N xR N for all i. 



(1.26) 



(Hi) H\(x,p) = max Hi(x,p) for (x,p) G x Mr. 

l<i<m 

(iv) There exists a, possibly empty, compact set K of such that 

(a) Hi(x,p) > on K x 1^ for all i, 

(b) If Hi(x,p) > r] > and d(x,K) > r), then {H x ) p p - H x > #(r/) > 0. 



Condition (|1.26p (m) means that we require the existence of a biggest Hamiltonian and Con- 
dition (jl.7p (ii) has to be satisfied only for this biggest Hamiltonian H\. Roughly speaking, 
everything is under the control of H\. 

Let us roughly explain how we can overcome the difficulty mentioned after (|1.24|) . by using 
(|1.25|) or (|1.26p . As for single equations, we make the change of function exp(wj) = Uj. The 
function w is solution to the new system 



;i.27) 



dwj 
dt 



+ Fi(x, Wi, Dwi) + dijexp(wj - Wi) 



0, i = h 



,m, 



with Fi(x,w,p) = exp(—w)Hi(x,exp(w)p). Without loss of generality, we can replace w with 
v G W 1,oc (T N x (0, oo)) m belonging to the w-limit set of {w(., .+t) + ct, t> 0}, where c is 
the ergodic vector. For shortness, we still denote v by w. 

Under (jl.25p . the properties of the F^s which are inherited from the H^s are 



;i.28) 



(*) (Fi) w (x,w,p) > for a.e. (x,w,p), 

(ii) There exists a, possibly empty, compact set JC of such that 

if Fi(x,w,p) > 7] > and d(x,IC) > r], then (Fi) w (x,w,p) > ^(rj) > a.e. 



Surprisingly, in this case, we are able to reinforce (11.23P by choosing a xt G T such that 



;i.29) 



m(t) = min zJx, t) := z\(x t , t) = z<i(x u t). 

x£T N , i=l,2 



This fact, (|1.20j) and (jl.22|) give us two inequalities 

( F 1 (x t ,wi,Dwi) + 1 - exp(w 2 - wi)(x t ,t) > 77, 
{ F 2 (xt,W2,Dw 2 ) + 1 - exp(wi - w 2 )(x t ,t) > r). 

Then, if w\(xt,t) < w 2 (xt,t) for instance, we have 

(1.30) Fi(x t ,w\, Dw\) > rj. 

Now, we can apply assumption ([1.280 (m) and continue the proof accordingly. The fact that 
the minimum in ()1.29p is achieved at the same point both for z\ and z 2 is a crucial point. 
This is a consequence of our new assumption ([1.25|) (m). 
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Now, in the case of (jl.26p . the properties of the F^s which are inherited from the H^s are 

(i) (Fi) w (x,w,p) > for a.e. (x,w,p), 

(ii) wi(x, t) < Wi(x, t) for all (x, t) G x (0, oo) and i = 1, . . . , m. 
(Hi) There exists a, possibly empty, compact set K, of such that 

if Fi(x,w,p) > rj > and d(x,IC) > rj, then (Fi) w (x,w,p) > ^(r/) > a.e.. 

Let us mention that (jl.31j) (n) is a consequence of the new assumption (ll,26p (m). In this 
case, we replace (11.29P by 

mi(t) = min z\(x,t) := z\(xt,t). 

x&T N 

Here, (|1.31P (m) implies easily (jl.30p . so we can apply (11.311) (ii) to prove that m\(t) tends to 
as t — > oo and this is enough to the convergence (|1.21|) . 

To state our result, we need to introduce some assumptions on the coupling. The ir- 
reducibility of the coupling is a classical assumption when dealing with systems of PDEs. 
Roughly speaking, when the coupling is irreducible, it means that the system is not separated 
into many smaller systems. 

(1 32) ^ 6 Sa ^ ^ S ^ rrec ^ uc ^ we ^ f° r an y x e ^ N an d subset I £ {1, • • • , m}, 

there exist i £ I and j ^ I such that dij(x) ^ 0. 

Under (jl.25p . we need the existence of a line with nonzero coefficients in the coupling, that 
is, 

(1.33) For all x € T N , there exists i such that dij(x) ^ 0, for all j = 1, . . . , m. 
Under (ll.26p . we need the following 

(1.34) We say that D(.) is nonzero if for any x € T , i,j = 1, . . . , m, there exists 
k € {1, • • • , m} such that ^(x) ^ and djk(x) ^ 0. 

Let us comment on this last condition. The main consequence of systems which have a biggest 
Hamiltonians, i.e., for which (|1.26p (m) holds, is 

Lemma 1.3. Consider (jl.ip where the coupling D(x) satisfies (jl.34p . Assume moreover that 
([1.26p (m) holds. Then we have 

limsup max (u±(x,t) — Uj(x,t)) < 0. 

t^oo x€T N , j=l,-,m 

To prove this result, we subtract the 1st equation from the jth in (jl.ip and use (jl.34p . 
Actually, (]1.34p is not the most general assumption we can state but maybe the simplest one. 

We are now able to state our main result, the proof of which is given in Section [6] 

Theorem 1.4. (Main convergence result) Suppose that the coupling D is independent of x 
and one of the two following conditions holds 

(i) Hi satisfies (11.25P and (I1.33P holds, 
(ii) Hi satisfies (fL26l) and (fl~32j) . (Oil hold. 

Then, the solution u = (u\, . . . ,u m ) 6 W l, °°(T N x (0, oo)) m of (jl.ip converges uniformly to 
a solution (uooi, . . . ,Voom) of (fL8|) . 

The proof of this theorem is difficult, very technical and relies on several auxiliary results. 
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1.3. Some applications of the main result. First important examples for which the main 
result can be applied are nonconvex systems. The following example is drawn from [4], 

(1.35) Hi(x,p) = ipi(x,p)Fi(x, p) - fi(x), 

where /j £ C(T N ) is nonnegative, 6 C(T x M 7V \{0}) is strictly positive and ipi(x,p) = 
\p + qi(x)\ 2 — \qi(x)\ 2 . Moreover, we assume that 

(1.36) K = {xeT N : fi(x) = \qj(x)\ = for all i,j = l,...,m} ^ 0. 
Under the above conditions, we have c = (0, . . . , 0). We compute 

(1.37) (H t ) p (x,p) p - Hi(x,p) = \p\ 2 F t (x, A) + fi (x). 

\P\ 

It is straightforward to see that Hi satisfies fll.25f) with K defined as in (|l,36p . 
Another application is the system 

f ^ + | J Dn 1 + / 1 (x)| 2 -|/ 1 (x)| 2 + Ul -n 2 = 0, 

(1.38) <^ (x,t) G T x (0,+oo), 
I + \Du 2 + f 2 {x)\ 2 - |/ 2 (x)| 2 + U2 - Ul = 0. 

where fi € C(T ). This example was neither covered by previous convergence results nor by 
the other convergence results described below in Section 11.41 It solves a question which was 
asked in [6] where the authors obtained the convergence for (I1.38P with /i, / 2 are constant. 
It is straightforward to check that (|1.25|) holds but it is also a particular case of the more 
general application we give now. 

The following theorem is an important consequence of the main result in the case of systems 
with strictly convex Hamiltonians. To enlight the main ideas, we provide the proof hereunder 
in the particular case where there exists a C 1 subsolution to the ergodic problem. The proof 
for the general case is provided in Section [71 

Theorem 1.5. Suppose that D is independent of x and satisfies (|1 .32[) and (|1.33p . We 
assume that, for i = 1, • • • , m, 

Hi(x,-) is strictly convex and coercive uniformly in x € T . 

Then there exists c = (c\, c\) and a solution v £ W l,oa (T N ) m of fll .8 j) such that u + ct — > v 
in C(T N ) m , where u is the solution of (ll.ip . 

This theorem extends the result of [8] to systems. It also gives a full answer to the Eikonal 
type Hamiltonians case of [6j [22]: when the Hamiltonians are strictly convex, one has the 
convergence regardless J- is empty or not. In particular we obtain the convergence in the case 
of Example 11.21 In the non-strictly convex case, it is known that we cannot hope to obtain a 
convergence result, see Example 11.81 for a counter-example. In the next section, we present a 
particular result in this context with not necessarily strictly convex Hamiltonians. 

We learnt very recently that Mitake and Tran [23] obtained the same result, Theorem II. 5 [ 
by a different approach. They use a dynamical approach which corresponds, in the case of 
systems, to the method of [8]. Here, the result is a particular case of a general PDE approach. 

Proof of Theorem \1.5\ (when there exists a C 1 subsolution to ([1 .8j) ). To make the presenta- 
tion easier in this introduction, we consider a particular case containing the main ideas of the 
proof. See Section [7] for the general case. We then assume that v is a C 1 subsolution of (|l,8p . 
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Set Wi = Ui — Vi for i = l,...,m where u is the solution of (jl.ip . Then w is the bounded 
solution of 

dw- m 

' + Hi(x,Dvi + Dwi) - Hi(x,Dvi) - g^x) + } j d i j(x)wj = 0, i = l,...,m. 



dt 



3=1 



Where gi{x) := —Hi(x,Dvi) — Y^jLi dij(x)vj > and gi G C(T ) for all i = 1, . . . , m since 
v is a C 1 subsolution of (|1.8p . We introduce the new Hamiltonians Gi(x,p) = Hi(x,p + 
Dvi) — Hi(x, Dvi) — gi(x). Since Hi is coercive then the solutions u of (ll.ip and v of (|1.8jl are 
Lipschitz continuous. In order to apply Theorem 1 1.44 it is then sufficient to check that (|1.25|) 
holds with K = and p bounded. It is left to the reader. Finally, we obtain the large time 
behavior of the solution by applying Theorem 11.41 □ 

1.4. Miscellaneous results. We obtain some particular results under different assumptions 
on the Hamiltonians. These results are not completely covered by the main result and bring 
to light some interesting phenomena. 

1.4.1. Hamiltonians of Eikonal type. We focus on the setting of Namah and Roquejoffre [25], 
i.e., when the Hamiltonians take the form 

Hi(x,p) = Fi(x,p) - h{x), x G T^p G R N . 

For i = 1, • • • , m, we assume 

(1.39) Fi(x, •) is convex, coercive uniformly for x 6 T N and Fi(x,p) > Fi(x, 0) = . 
We can extend the results of |22[ |6] when T defined by (jl.lOp is replaced by 

(1.40) S := {x G fi(x ) = min fi(x), for all i} ± 0. 

x£T N 

This latter condition means that the /j's attain their minimum at the same point but 
their value at this point may be different. 

Under this new weaker condition, we can prove the result when the coupling matrix is 
independent of x. The idea is that we can find an explicit formula for the q's together with 
a constant solution of the ergodic problem. It is then possible to bring the problem back to 
the one proved in [6] and |22j . 

Theorem 1.6. Assume that D is independent of x and satisfies (|1.32p . Moreover, we assume 
that Fi G C(T N xR N ), foe C(T N ) satisfy (fTMj) and (fTIUjl . respectively. Then there exist 
c = (ci,...,ci) G M m and G W 1,oa (T N ) solution of (|1.8p such that u + ct — >• Uoo in 
C(T N ) m , where u is the solution of (jl.ip . 

1.4.2. Strictly convex Hamiltonians. Theorem ll.5l is a natural extension of Davini-Siconolfi [8] 
to systems. Here is another result in this direction with the following assumptions. 

(1.41) Hi(x,p) > p(x)Ki(p), Hi(x,0) = Ki(0) = 0, K{ is convex for i = 1, . . . , m, 
where p is a positive T^-periodic function. 

(1.42) There exists at least one i G {1, . . . , m} such that iQ is strictly convex. 
Our result is the following 

Theorem 1.7. Assume that Hi satisfies ()1.41 j) - f)1.42|) and the coupling D is independent of 
x and satisfies (11.321) . Assume u G W 1,0 °(J N x (0, oo)) m is the solution of (fTTT|) . Then, there 
exists f/GR such that ui — > U uniformly for all i. 
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Typical Hamiltonians satisfying Theorem 11,71 are given in Example 14. 11 If we compare our 
result for systems with the corresponding one in j8j for a single equation, we see that we need 
the additional assumption (jl.4ip . However, we can prove the convergence result for systems 
with convex Hamiltonians, when merely one of the Hi 's in (jl.ip is strictly convex. It means 
that one strictly convex Hamiltonian is enough to control the large time behavior of the whole 
system. This condition is also necessary, see the counter-example 11.81 when all the H^s are 
convex but no one is strictly convex. Theorem 11.71 improves a similar result of [22] which was 
obtained for (jl.43p in the case a = f3 = 2. 



Example 1.8. Consider 



(1.43) 



+ \Dux + l\ a 
+ \Du 2 + lf 



1 + U\ — U 2 = 0, 



(x,t) £ R x (0,+oo), 



dt 

— f + \Du 2 + If - 1 - ui + u 2 = 0, 
at 

u\(x, 0) = u 2 (x, 0) = sin(x). 

If a = (3 = 1, then (jl.4ip holds and the unique solution of (|1.43p is u(x, t) = (s'm(x — t),sm(x — 
t)) which clearly does not converge as t — > oo. This is a counterexample for which we do not 
have the convergence when (jl.4ip holds alone. If a > 1, /3 > 1, then (jl.4ip - (jl.42p hold and 
we can prove the convergence of the solution for this system. 



1.4.3. The case when all Hamiltonians are identical. We focus on the case where all the 
Hamiltonians in the system (jl.ip are identical. In this setting, we can give an easy proof of 
the large time behavior of solutions of (jl.ip for a very wide class of Hamiltonians. We show 
that the large time behavior for systems is actually inherited directly from the case of a single 
equation, i.e., we prove that the convergence result holds for systems as soon as it holds for 
the corresponding single equation. This result generalizes a result of |22] obtained for systems 
under assumptions related to the framework of [3]. Here, we prove the result under a very 
natural assumption when studying the large time behavior for system. 

(1.44) The solution of equation fjl ,3|) has large time behavior . 

The result is 

Theorem 1.9. Call u G BUC(T N x (0, oo)) m the solution of (jl.ip . Assume that the coupling 
D(x) satisfies (jl.34p . Hi = Hj for all i,j = 1, . . . ,m and (jl.44p holds. Then u(.,t) converges 
uniformly to a solution v of (jl.4p . 

1.5. The relation among all convergence results. Let us compare all results which have 
been stated above to give the reader a clearer overview. For Hamiltonians of Eikonal type, 
we obtain, according to us, a satisfactory answer to the general case for systems which was 
left open in [6] and [22], see Theorem 11.51 When the Hamiltonians are not strictly convex, 
we cannot hope a convergence result in the whole generality but, in this case too, we obtain 
a new result, Theorem 11.61 The important point in Theorem 11.61 is that we can compute the 
exact value of the ergodic constant. Actually, when we have in hand this ergodic constant, 
we can prove that the assumptions of Theorem 11.41 hold. So Theorem 11.61 is contained in the 
main result Theorem 11.41 but let us underline again that the important part in the proof of 
Theorem 11.61 is the computation of the ergodic constant, see Lemma 13.11 
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A consequence of Theorem 11.41 is Theorem 11.51 which proves the convergence result for 
systems of strictly convex Hamiltonians. This is a natural extension of the result in [8] to 
systems. We also obtain another result for strictly convex Hamiltonians, see Theorem 11.71 
This latter result is not completely covered by Theorem 11.41 since we need only one strictly 
convex Hamiltonian in Theorem 11.71 We refer the reader to Example 11.81 with a > 1, f3 > 1 
and Example 15.21 for more discussions. 

Finally, Theorem 11.91 requires all the Hamiltonians to be identical. This result is not 
contained in Theorem 11.41 since it works for a very wide class of Hamiltonians provided the 
convergence result holds for the corresponding single equation. 

1.6. Organization of the paper. This paper is organized as follows. In Section O pre- 
liminary results for the coupling of the systems are given, the ergodic problem for coercive 
Hamiltonians is solved and basic properties of the solutions like existence, uniqueness, Lip- 
schitz regularity and relative compactness are presented. Next sections are devoted to the 
proofs of the theorems stated in the introduction. The proof of Theorem 11.61 is given in Sec- 
tion O the proof of Theorem 11.71 is given in Section |4] and the proof of Theorem 11.91 is given 
in Section [5j Section [6] contains the proof of the main result (Theorem [L4]) . This is the most 
technical and involved part. Finally, we give the proof of Theorem 11.51 in Section Since 
the ideas of this proof are based on the ideas used in the proof Theorem 11.41 we strongly 
recommend the reader to read it after reading Section [6l 

Notations: Since we only work with viscosity solutions in this paper, we will drop the term 
"viscosity" hereafter. We denote by C(T N ) m the set of functions u = (u\, . . . ,u m ), where 
iLi : T N — > R is continuous for alH = 1, . . . , m. 

Acknowledgments. We would like to thank O. Ley without whom we would have never 
finished this paper. We thank G. Barles who gave us a lot of useful advice to improve the 
first version of this work and M. Camar-Eddine for useful discussions. We thank H. Mitake 
and H. V. Tran for letting the author know about their recent work. 

2. Some preliminary results 

2.1. Preliminaires on coupling matrices. Here is one key property of irreducible matrices. 

Lemma 2.1. ([6]) Suppose that D(x) = (dij(x))i<ij< m satisfies (|1.2p and (jl.32p . Then for 
all x £ T , D(x) is degenerate of rank m — 1, ker(L>(x)) = span{(l, • • • , 1)} and the real 
part of each nonzero complex eigenvalue of D(x) is positive. Moreover there exists a positive 
continuous function A = (Ai, . . . , A m ) : — > R m such that A(x) > and D(x) T 'A(x) = 
for all x G T N . 

2.2. Ergodic problem for coercive Hamilton-Jacobi systems. We solve the ergodic 
problem for systems of Hamilton-Jacobi equations with coercive Hamiltonians. 

Theorem 2.2. Consider system (jl.ip where Hi is coercive in p uniformly in x, D{.) satisfies 
(Q2|) . Then, there is a solution ((ci, ci), v) G R m x W 1,oc (T N ) m to with (ci, ...,ci) G 
kerD(x) for all x G T . Moreover, (cx,..., c\) is unique in kerD. 

Remark 2.3. The classical result for scalar first-order Hamilton-Jacobi equations is due 
to Lions-Papanicolaou-Varadhan |18] , In general, the ergodic problem (jl.4j) is solved in the 
following way: we first prove a gradient bound for the regularized equation Xv x + H(x, Dv x ) = 
0. Due to the coercivity of H, this gradient bound is independent of A. Since v x may not 
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be bounded, we make a change of function w x = v x — v x (xq) in the equation. It follows 
l-Du^l < L and w x is uniformly bounded thanks to the compactness of T . And then, the 
requirements of Ascoli's theorem are fulfilled. Here, for systems with a x-dependent coupling 
matrix, such an approach does not work since the change of variable w x = v x — v x {xq) leads 
to additional terms in the system which are difficult to control. That is why we required the 
coupling matrix to be independent of x to prove j6j Theorem 4.3]. Here we can overcome this 
difficulty with Lemma 12.51 below. Let us point out that we cannot use the gradient bound to 
obtain (HOI). 



Proof of Theorem \2.2\ Step 1. Ergodic approximation. We consider the ergodic approxima- 
tion to (JTB|) : for A G (0, 1), let v x = (v x , . . . , be the solution of 

m 

(2.1) Xvi + Hi(x,Dvi) + ^2dij(x)vj = x G T N , 1 < i < m. 

i=i 

Lemma 2.4. ([6]) There exist a unique solution v x of (|2.ip and a constant M > indepen- 
dent of A such that 



x M 

(2.2) < < — and 

A 



DvH OHoo <M, i = l,...,m. 



Step 2. Some uniform bounds. Here is the key lemma which helps us improve the result 
proved in [6]. 

Lemma 2.5. Under the assumptions of Theorem \2.2l there exists a constant M such that 
for all x G T^, i = 1, . . . , m, we have 

(2.3) \vf{x) - v x {x*)\ < M for any fixed x* G T^. 
The proof is postponed. 

From Ascoli's theorem, there exist c = (ci, . . . , c m ) G M. m and v G C(T N ) m such that, up 
to subsequences, for i = 1, . . . , m 

A^ A (x*) ->• -a and vf - v x (x*) -> Vi in C(T N ) as A 0. 

Notice that does not depend on the choice of x* since, for any x*,y* G 

(2.4) | - Xv x (x*) + Xv x {y*)\ < XM\x* - y*\ -)■ as A -> 0. 

Moreover, multiplying ()2. 1|) by A for all z and sending A — > 0, we obtain —^2jdij(x)ci = 

which gives D(x)c = and therefore c G kerL>(x) for all x G T^. 

Step 3. Stability result for viscosity solutions and conclusion. We rewrite (|2.1|) as 



m 

(2.5) Xv x + Hi(x,D(v x -v x (x*))) + J2dv(v$ -v x (x*)) = inT N , 

i=i 

by noting that J2f=i dij{x)v x (x*) = for all x G T N thanks to (fL2l) . 
We then use the stability result and pass to the limit in (j2.5[) to get 

m 

(2.6) -ffi(x, D^j) + dijVj(x) = Ci in T^, 1 < i < m. 

3=1 

Then (c,v(-)) is solution to (|1.8p . The function v depends on x* but c does not. 

From Lemma \2.1\ the kernel of D is spanned by (1, . . . , 1). Thus, any c G ker D has the 
form (ci , . . . , ci ) . The proof of uniqueness of c is classical and can be found in [B] . □ 
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Proof of Lemma 12.51 We set 

Wi (x) = w^(x) = vf(x) - v$(x*). 
Thanks to (|2.2|) . obviously \w\ \ < M. Using (|2.2|) again for (|2.5p . we have 

m 

| djj (x)wj (x)\ < C for all i = 1, . . . , m and x E T N , 

3=2 

where C is independent of x and A. For any i > 2, we have 

mm m m 

dii | = I ^-w^ — X] dijWj\<C — dij\wj\, 

3=2 j=2, j+i j=2, j^i j=2, j^i 

i.e., 

m 

(2.7) ^2<Uj\wj\ < C for any i > 2. 

Call (Ai, . . . , A m ) the function given by Lemma l2.1i We have 

m mm mm m 

-y^\wj\dijki = I^K^JdyAj) = 5jAi^Jdtj|wj| < C(^jAj). 

j=2 j=2 i=2 i=2 j=2 i=2 

Assume |ia?2 I = minj>2 | | , we have 

m m spm a 

dii|n>2| = - dijl^l < - l^jMij < C — ^ — -■ 

i=2 3=2 1 

Thanks to (jl.32p . we have d\\ > 0. Using the compactness of and continuity of the 
coupling, there exists Sq > such that d\i{x) > 5q for all x € T^. Therefore, we have 

V m A- 

\w 2 \ <C^= 2 1 



Ai«5 

We finish the proof by a reduction argument, i.e., we assume that 

m 

< C for any 3 < k < m and < C for 1 < I < k — 1, 

j=k 

and we will show that \u>k\ < C . By similar arguments like those to obtain the bound for 
\u>2\, we then assume that \wk\ = minj>fc \vjj\. We have 

fc— 1 fe— 1 m fc— 1 m fc— 1 m 

(^Ai^dyOKI = (-^^dijAj)!^! < - J^K-lJ^dij-Ai < C(^Ai). 

i=l j=l j'=fc i=l j=fc i=l i=fc 

If Ei=i ^-i Et =1 ( s ) > f° r an x e '^ Ar ' ^ e conclusion follows easily by the compact- 
ness of and the continuity of the coupling. We then assume by contradiction that 
Et"i A iEi=i dij(x ) = for some x € T N , §T3$) yields d i3 \x G ) = for all 1 < i < 
k — 1, k < j < m. We get a contradiction with the choice I = {1, . . . , k — 1} in (jl.32|) . □ 
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2.3. Maximum principle and compactness properties of the solution. 

Proposition 2.6. Suppose that u, v are a subsolution and a supersolution of (jl.ip . respec- 
tively . Assume that either the Hi 's are coercive in p or u (or v) is Lipschitz. 

(i) Let uq, vo G C(T N ) m . If u, v are respectively a subsolution and a supersolution 
of (jl.ip . then for any t > 0, 

(2.8) max sup — < max sup (ui(-, 0) — Vi(-, 0)) + . 

l<i<m >yjv l<i<m 

(ii) For any uq G C(T N ) m , there exists a unique continuous solution of (jl.lj) . 

Using the existence of solutions of the ergodic problem proved in Theorem I2.2j we can 
prove 

Proposition 2.7. ([6]) Under the assumptions of Theorem \2.2\ let uq G W 1,oc (T N ) m and u 
be the solution of (jl.ip with initial data uq. Then 

\u(x,t) + ct\ < C, x G T N , t G [0, oo), 

\u(x, t) — u(y, s)\ < L(\x — y \ + \t — s\), x,y £ T N , t, s G [0, oo), 

with C, L are constant. 

From Proposition 12.71 and Ascoli theorem, we obtain easily the relative compactness of 
{u(.,.+t) + ct, t > 0} in C{T N ). 

2.4. First partial convergence result. The following result will be often used in the sequel. 
Roughly speaking, it gives the convergence of the solution on the set where the Hamiltonians 
are nonnegative. 

Lemma 2.8. ([6]) Let u = (u\, . . . , u m ) be a solution of (jl.ip with c = (0, . . . , 0). Assume 
that (jl.ip admits a maximum principle and there exists a nonempty compact set K of T N 
such that 

Hi(x,p) > on K x R for all i = 1, ...,m. 

Assume one of the two following conditions holds 
(i) (031 holds and u G BUC(T N x (0,oo))"\ 

(ii) (jl.32p holds and either H is coercive in p uniformly in x or u £ W l,oc (T N x (0, oo)) m . 
Then u(.,t) converge as t tends to infinity for all x £ K. 

Proof of Lemma \2.8[ The proof for the case (i) holds is given in the step 3 of the proof of 
Lemma 16.51 We only outline the proof when (iii) holds, see [H Lemma 5.6] for details. 
Formally, since Hi > and D(x) T A(x) = for x G K where A is given by Lemma l2.1j we 
have 

(2.9) d(YZi^i) < Qi (Xj t)(£Kx (Qj ^ 

So for x G K, t i-> Y1T=\ ^i( x ) u i( x it) is nondecreasing and therefore, it converges to some 
function g(x) as t tends to infinity. 

In (ii), if u G W l,oc (T N x (0, oo)) m , then we can see easily that the conclusion of Proposi- 
tion j2T7] holds. Otherwise if the H^s are coercive, by applying Proposition 12.71 then we still 
have (u(-,t))t>o is relatively compact in C(T ) and there exists a sequence t n — > +oo such 
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that u(-,t n ) converges uniformly on T N as n — > +00. From the maximum principle for system 
(II, ip . we obtain that for all n, q € N, 

max sup \ui(-,t n + ■) - m(-,t q + -)\ < max sup t n ) - t q )\ 

1 ^^ m T Jv x[0,+oo) l<i<m JN 

and therefore (u(-,t n + •))„ is a Cauchy sequence in W 1,oc (T x [0, +00)). Thus it converges 
uniformly to some function w € W l '°°(T N x [0,+oo)). By the stability result for viscosity 
solutions, w is still a solution of (II. ip (see [UG2E] for details). Since YldLi ^~i^i(xo, t) converges, 
YaLi A-i w i( x o, t) does not depend on t anymore for xo € K. It follows 



dt 

This implies 



0, x Q e K. 



^ Ai(x )Hi(x , Dwi) = 0,i.e. Hi(x ,Dwi) = for i = 1, . . . , m. 

i=i 

Then, we obtain a linear system for w: 
dw' m 

(2.10) + } j dij(x )wj(x ,t) = 0, i.e. w(x ,t) = ex.p(-tD(x ))w(x ,0). 

j'=i 

Since D is irreducible, from Lemma [2. 11 is a simple eigenvalue and all the nonzero eigenvalues 
have a positive real part. It follows that there exists a matrix A such that 

exp(-tD(x )) = A + 0{e- rt ), 

where r > is the smallest real part of the nonzero eigenvalues. Therefore, 

w(x ,t) ->• Aw(x ,0) + w =: noo(x ). 

t— >+oo 

It is now straightforward to (xo) is the limit of u(xo,t). □ 

3. Proof of Theorem 11.61 

For this section, it is convenient to rewrite the stationary system under the form 

in 

(3.1) Fi(x, Dm) + dij-Uj = fi + ci x G T^, i = 1, . . . , m. 

j'=i 

where c = (ci, . . . , cx) is the ergodic constant. The existence of a solution to this system is 
given in Theorem 12.21 

Let x Q € 5, we recall that S is defined by ([LID]) . We show that ci = - E ^^ x ' o) by 
constructing a constant solution for system (13. If) with respect to this constant. 



Lemma 3.1. The system 



K b- 

(3.2) Fj(x, Din) + ^ djj^j = bj- j 1 , i = l,...,m. 

j=l £-<i=\ Ai 

has a constant solution. 
The proof is postponed. 
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Proof of Theorem \l.(A Step 1. Reduction to Lipschitz initial datas. Given uq G C(T N ) m , set 
S(t)uQ = u(x,t) for t > where u is the solution of (jl.3j) with initial datum no- Then it is 
easy to see that S(-) generates a nonlinear, monotone, nonexpansive semigroup in C(T N ) m . 
Since S(t) is nonexpansive, it is sufficient to show the result for uq G W 1,00 (T N ). 
Step 2. Explicit value of the ergodic constant. Using the uniqueness of the ergodic constant 
and Lemma 13, 11 we obtain the formula for the ergodic constant 

3.3 a = - mm 1 l m = ' for any x G S, 

^ Di=i A* E i= i A* 

where the constant vector A = (Ai, . . . , A m ) > given by Lemma l2.1i 

Step 3. Boundedness of u + ct and use of stability results. Set v := u + ct. We apply 
Proposition 12.71 to deduce that v is bounded. Then, we can introduce the relaxed half-limits 

(3.4) v{x) = limsup * v(x, t) = lim sup{v(y,s) : y £ B(x,l/t), s > t}, 



t—>-+oo 



t—t+oo 



v(x) = liminf * v(x, t) = lim ini{v(y, s) : y G B(x, 1/t), s > t}, 

t— s-+oo t— Y+oo 

where the half-limits are taken componentwise. 

By the stability result for viscosity solutions, v and v are respectively a sub and a super- 
solution of (|3.ip . 

Step 4- Uniform convergence of the sequence v(-,t) on S. We have that v = u + ct is the 
solution of the system: 

tttf / ^+ F &^) + Y%=i<kM = fi + c (x,t)£T N x(0,+oo) 

(3 ' 5) \v r (x,0)=u l0 (x) x£T N , t-L.-.m. 

From Lemma 13.1^ there exists a constant solution wq = (wiq, w m o) for (I2.10p with bi = 
fi(xo), xo 6 S for i = 1, . . . , m. Set Wi(x, t) = Vi(x, t) — Wio, then (w±, . . . , w m ) solves 

dw m 

+ Fi(x,Dwi) +y)djjVj = fi(x) - fi(x ) (x,t) e x (0, +oo), x G S, i = l,...,m. 

For this new system, the requirements of Lemma 12.81 are satisfied with K is chosen to be <S, 
hence we can apply it to have the convergence of Vi(.,t) as t — > oo for all x G S. 
Step 5. Use of the comparison principle for (|3. 1 j) to conclude. The functions v and v are 
respectively a sub and a supersolution of (|3.ip satisfying v < von S. We have a comparison 
principle for the stationary system (|3. 1|) . 

Theorem 3.2. Assume that D is independent of x and satisfies (jl.32p . We assume moreover 
that (Q9l) and (QUI) hold. Let u G USC(T N ) and v G LSC(T N ) be respectively a bounded 
subsolution and supersolution of (|3.ip such that 

v>i(x) < Vi(x) , i€ {l,...,m}, x G S. 

Then 

u < v in T N . 

The proof is postponed. Using this theorem, we infer that v < v and hence, v = v = i>oo- 
It proves the uniform convergence of u + ct to in and Uqo solves (|3.ip . □ 

Remark 3.3. When (|1.10p holds, the right hand side of system (|3.ip is nonnegative( that is, 
all its components are nonnegative) . When (|1.4U|) holds, the right hand side of the system 
(13. ip is (/i + ci, . . . , f m + ci) whose signs may not be nonnegative anymore, see Example 11.21 
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The following example shows the difficulty when the coupling depends on x, even the /j's 
attain their minimum at the same point but with different values. 

Example 3.4. Let d G C{T N ) satisfying max T jv d > min T jv d > 0. We can show that there 
exists c > —1 and a bounded solution (1)1,1)2) to the system 

„ fi x / ^ + \Dv 1 \ + d(x)(v 1 -v 2 ) = c, 

(3.6) < x € T 
\ ^ + |Z)t; 2 | + ( i(x)(t; 2 -t; 1 ) = 2 + C 

(see Theorem 12. 2p . Note that, for (|3.6|) . J- = but /1 = and _f 2 = 2 achieve their minimum 
and 2 respectively, at each point of so S = T N . To follow the lines of the proof of 
convergence of |25} \6[ |2"2]. we need to identify a nonempty set S such that Vi(x,t) converges 
as t 00 for any x G S and such that we have a comparison principle for (|1.8|) with prescribed 
values on S. But, summing the equations in (|3.6p . we obtain 

(3.7) d( Vl +v 2 ) + |£)ui| + |I)U2! = 2 + 2c > Q) 

which shows that it is hard to have such a set. We do not have the answer for this case. 

We turn to the proof of the results used in the proof of Theorem 11.61 

Proof of Lemma \3.1\ Since we construct constant solutions, we do not need to care about 

y^ m A b 

Fi(x,Diii) = Fi(x, 0) = 0. Set a := ^Lf>i l z . We want to find a solution of 

III 

dijUj = bi — a, i = 1, . . . , m. 

j"=i 

We need to use 

Lemma 3.5. Assume that D is independent of x and satisfies fjl .32(1 . Then, the matrix 
obtaining after deleting the ith row and ith column is invertible. 

The proof is given at the end of this section. 

From this lemma, we can find a unique solution (u±, u m _i) satisfying 

m— 1 

d^Uj = bi — a, i = 1, . . . , m — 1. 

j'=i 

Set ti m = 0, we have 

m 

(3.8) ^""j = bi — a, i = 1, . . . , m — 1. 



We claim that (I3.8P holds for i = m. Multiplying the ith equation in (I3.8P by Aj and summing 
all equations for % = 1, . . . , m — 1, we obtain 

m— 1 m m— 1 m— 1 m 

( 2J Kdij)uj = ^ - ^2 ^* a ' i-e ' X] -^mdmjUj = A m (d - b m ), 

i=l j=l i=l i=l j=l 

which is exactly what we need. □ 
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Proof of Theorem \3.2\ Proving directly this theorem seems hard because of the lackness of 
positivity in the right hand side of (13. ip . see Remark 13.31 We instead try to bring it back to 
Theorem 13.21 with (jl.lOp holds instead of (jl.40p . To do so, the fact that the coupling matrix 
D(x) independent of x plays a key role. 

Using Lemma 13. 1\ there is a constant solution no = (uq±, Uo m ) of system (|3.2p with 
bi = fi(xo). Writing system (|3.ip as: 

m 

Fi(x, Dm) + dijiij = (fi - fi(x )) + fi(x ) + c 
and, setting vj = Uj — uqj, we obtain that v = (yi, v m ) solves: 

m 

Fi(x,Dvi) + '^2<ii j v j = fi- fi(x ), x G T^, i = l,...,m. 
i=i 

Note that the g^s defined by gi{x) = fi{x) — fi(xo) attain their minimum at the same point 
xq and their value at xq are equal to 0, i.e. T satisfies (|1.1U|) with T := S and the /j's are 
replaced by the g^s. It follows that (jl.lOp holds, we then apply Theorem 13 . 21 with (jl.lOj) holds 
to obtain the conclusion. □ 

Proof of Lemma \3. 51 Call (Aj)$=i m the vector in Lemma 12.11 Call E the matrix after 
deleting the mth row and mth column from the matrix D, our goal is to prove that E is 
invertible. By contradiction, assume there exists x = (xi, ...,x m -i) ^ such that Ex = 0. It 
is straightforward to check that y = (x, 0) satisfies Dy = 0, and from Lemma 12.11 again, we 
conclude that x = which is a contradiction. Therefore, E is invertible. □ 

4. Proof of Theorem 11.71 
Before giving the proof of Theorem II. 7\ let us give typical examples 
Example 4.1. A typical example of system (jl.ip satisfying (|1.4ip - (ll,42p is when 

Hi(x,p) = fi(x,p)\p\ a > +Y,i<j<k m ij(\P + Hj\ aiJ ~ l<?ul aij )> l<i<m, 

where, for all i,j, fi > 0, Qj, a,j > 1, rriij > 0, qij G M. N and there exists 1 < iq < m such that 
fi (x,p) > r] > and Oi > 1. In this case, Hi enters the framework of [8]. 

Let us point out that there are Hamiltonians satisfying (ll.4ip -( fl.42p which are not covered 
by the results of [4], see Example 15.21 for details. 

Theorem (|1.7p improves a result of |22] where convergence for (jl.43p with a = (3 = 2 is 
proved. The proof of Theorem (jl.7p is based on similar ideas as in [22]. The main change 
is that we can prove the proposition 14.31 which is the main estimate, for any strictly convex 
Hamiltonians after refining classical Jensen inequality. 

Proof of Theorem \1. 7[ 

Step 1. Boundedness of u. With assumption (jl.4ip . we deduce that the ergodic constant is 0. 
In particular, the solution of (jl.ip is bounded. 

Step 2. The functions U max (t) := max^j Ui(x, t) and U m i n (t) := min Xj iUi(x,t) are monotone. 
This result is proved in [22]. We make here a formal proof for U max . We fix t and assume, 
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without loss of generality, that U max (t) = m&x x ^Ui(x,t) = u±(xQ,t). Then 

m 

Dui(xo,t) = 0, dijUj(xQ, t) > 0. 
i=i 

It follows from the first equation of (II. ip and (ll.4ip that 

du m 
= —(x ,t) + Hi(x G ,Dui(x ,t)) + ^2d lj u j (x ,t) > U^ iax (t). 

3=1 

From Steps 1 and 2, we can set L = lim^oo U max (t) and I = lim^oo U m i n (t). If L = I, the 
proof is finished. We assume that L > I and we will show a contradiction. 
Step 3. Uniform convergence of a subsequence. From Lemma 12. 8( there exists a sequence 
t n — > +oo such that (u(-,t n + -)) n converges uniformly to some function w G W 1,oc (T N x 
[0, +oo)). By the stability of viscosity solutions, w is a solution of (jl.ip . By passing from u^s 
to u>j's, we get new information. That is, we have 

max u>i(x,t) = L, mm Wi(x,t) = I for all t > 0. 

x,i x,i 

Fix any t > 0. We have max Xi j t) = Wi (xQ, t) = L = max IiS Wi (x, s). Using as a test 
function, from (jl.ip . we see that 

m 

y^^d io jWj(xo,t) < => Wj(x ,t) = w io (x ,t) for all j, 
i=i 

where the last equality comes from the irreducibility of the coupling D. Indeed, we can use the 
following characterization of irreducibility ([6] and the references therein): D is irreducible if 
and only if for all i,j G {1, • • • , m}, there exists n G N and a sequence Iq = i, i\, 12, ■ ■ ■ ,i n = j 
such that ^ for all 1 < I < n (in this case we say that there exists a chain between 

i and j). Then, for any j G {1, . . . , m}, there exists n G N and a sequence i\, i%, ■ ■ ■ ,i n = j 
such that di l _ 1 i l ^ for all 1 < I < n. From the above inequality and fll.2j) . we deduce that 
(xo,t) = Wi (xo,t) and repeat the same arguments, we obtain easily that Wj(xo,t) = • • • = 
w h (x ,t) = w io (x ,t). 

This fact and a similar argument for the minimum leads to 

(4.1) max Wi(x, t) = L, mm Wi(x, t) = I for all t > and i G {1, . . . , m}. 

S^ep ^. Strict convexity of one Hamiltonian implies the unboundedness of Wi 's. Using Lemma 
12. 1[ we have 

q m m 

®{x,t) + V] AiHi(x,Dwi) = 0, where <3?(x,t) = ^ AjWj(x,t). 



dt 

i=i i=i 



Therefore 



It follows that 



d m 
—Mx, t) + p(x) KKi{Dwi) < 0. 



dt 

i=i 



(4.2) ^2^dx+ f VAA^^O. 
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Next, we recall the Jensen inequality in the multidimensional case. 
Proposition 4.2. 

(i) Let (j) be a convex function over an open bounded convex subset U C M. N . For any integrable 
function f : — > U, we have 



<p o f(x)dx > cf)( / f(x)dx). 



/ f(x)da 



(if) If we assume moreover that (f> is a strictly convex function, then, for any integrable function 
f : T N — > U which is not constant a.e., we have 



(j) o f(x)dx > 4>{ 1 f(x)dx). 

JN JjN 

The proof is given at the end of this section. 

Part (i) of Proposition 14. 21 yields f jN Ki(Dwi)dx > Ki[Jj N Dwidx] > for alH = 1, . . . , m. 
And from (jl.42p . we can assume without loss of generality that K\ is strictly convex. We 
have an important estimate for this strictly convex Hamiltonian 

Proposition 4.3. Fix L > I and a strictly convex function K satisfying K(0) = 0. Set 
A = {f e W 1 ' 00 ^") such that WfWwi,™^ < C, max / = L, mm / = I}. 

Then we have, for all f G A, 

K(Df)dx > /3 > 0, where (3 is independent of f . 

From Proposition 14.31 we derive 

\ V KiKi(Dwi)dx > AiKi(Dw\)dx > 5 > 0. 
Jt n ~[ Jt n 

in which 5 is independent of t thanks to (|4,ip . Using this for ()4.2p . we have 

9 f < -S, foralH. 



This leads to ^.y _qq as f tends to infinity. This is a contradiction with the boundedness 



dt Jjn p(x) 

p(x) 

of Wi's. It ends the proof of Theorem 11.71 □ 

Now, we turn to the proof of the key estimate. 

Proof of Proposition \4-3{ Note that, by periodicity of /, Jj N Df = 0. Therefore, by using 
Proposition 14.21 (i) and periodicity of /, we always have Jj N K(Df )dx > 0. 

We now assume by contradiction that such a /3 does not exist, therefore we can find a 
sequence (/ n ) € A such that 



/ K(Df n )dx < -. 



Ascoli's theorem claims, by passing to a subsequence if necessary, the existence of /o € 
W 1 '°°(T N ) so that 

(4.3) f n -»■ f in C(T N ). 

In particular /o is not a constant because max T jv fo = L> min T iv fo = I- 
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Moreover, since W 1,2 (T N ) is a reflexive Banach space, by passing to a subsequence if 
necessary 

f n ^go in W^\T N ). 

Then, it follows that 

(4.4) f n - g in L 2 (T N ). 
From P~3|) and (jO|) , we obtain 

ffo = /o a.e. 

From a classical result in calculus of variations, see [7], we have 

< I K(Dfo) < liminf / K(Df n ) < 0. 

Finally, we have 

/ K(Df ) = 0. 

We apply Proposition 14,21 (ii) to deduce that Dfo(x) = a.e, and therefore fo(x) = C, Vx € 
by continuity. It leads to a contradiction. □ 

Remark 4.4. Actually, the strict convexity of K was only used to deduce Df$(x) = a.e 
in last lines of the proof of Proposition 14.31 It follows that Proposition 14.31 can be easily 
established if K satisfies 

K(p) > for all p £ R N , K is convex and K(p) = <^4> p = 0. 

Thus, Theorem 11.71 is still true if we replace the strict convexity with the above condition. 

Proof of Proposition ^. 1 ^ (i) Set t = fj N f(x)dx, since 4> is convex then its subdifferential 
d(j)(t) is nonempty, 

<P(f(x))> ( f ) (t) + (f(x)-t,p). 

where p € d(p(t). Summing after integrating both sides of the above inequality with respect 
to x and using the special value of t, we obtain the result. 

For part (ii), since / is not constant a.e., the set A = {x € U,f(x) ^ t} has positive 
measure. Take p € d(j)(t), it is obvious that 

<Kf(x)) = <l>(t) + (f(x)-t,p) iixi A. 

We prove later that 

(4.5) > <f>{t) + (f(x) - t,p) if x e A. 

Integrating both sides of two above inequalities with respect to x and using the special value 
of t, we obtain the result. 

To prove (|4.5p . we assume by contradiction there exists x £ A such that 

^(f(x)) = ^(t) + (f(x)-t,p) if x £ A. 

Therefore, using the strict convexity of (j) and f(x) ^ t, we have 
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On the other hand, p G d<j>(t) and the convexity of <j> imply 

' + -) > + 1 



TV 2 2' 

Two above inequalities give a contradiction. □ 

5. Proof of Theorem 11.91 

Before proving Theorem ll.9| we introduce some assumptions to recall a result of [I] for 
single equations and its extension to the system (jl.ip with H\ = H2 in [22]. 

Either u is in W 1,00 (M JV x (0,oo)) or there is a continuous function 

(5.1) ^ m : [0,oo) — > [0,oo) such that m(0 + ) = and, for all x,y,p G M> N , 
\H(x,p) - H(y,p)\ < m(\x - y\(l + 

There exist 77 > and ip(rj) > such that: if H(x,p + g) > 77 and 

(5.2) { H(x, q) < for some x e Ac R N ,p, q G l w then, for all // G (0, 1]: 
jiH{x, fi~ x p + q) > H(x,p + g) + ip(r])(l - /i), 



(5.3) 



There exists a, possibly empty, compact subset K of such that: 

(a) £T(x,p) > on K x 

(b) for all 77 > 0, (JOD holds with ,4 = ^ for all 77 > 0, 
where K v := {x G : K) > 77}. 



Theorem 5.1. flQ) Assume that H G C{T N x t w ) satisfies dSU and ([B3]> . T/ien, any 
solution u G BUC(T N x (0, 00)) of (jl.3p converges uniformly to a solution u of (jl.4p . 

In [22], the authors proved the large time behavior of the solution of (jl.lD with m = 2, 
i?i = i/2 and satisfies the conditions as in Theorem 15.11 The proof in [22] is based on 
the ideas used in the proof of Theorem 15.11 And therefore, it only works under the set of 
conditions on Hamiltonians of Theorem 15. II But we observe that for this type of system, the 
convergence is actually inherited from the case of single equations. 

Proof of Theorem \1.9l Step 1. Some estimates for single equations. We choose any sequence 
(t n )n which tends to +00. For each n > 0, call & n be the solution to the equation: 

— + H(x,D$ n ) = (x,t)€T N x(0,+oo), 
$ n (x,0) = iti(x,t n ) xGT^, 

Note that ($ n , . . . , <I> n ) is a solution of (jl.ip with initial conditions t n ), . . . , u±(., t n )). 

Applying the comparison principle for the system (jl.ip . we obtain 

(5.5) sup \ui(x,t + t n ) - $ n (x,t)\ < sup \ui(x,t n ) - ui(x,t n )\. 
i=l,...,m, x€T N , t>0 l<i<m, xGl N 

(5.6) sup \® n (x,t) - <£> n+1 (x,rj)| < sup \ui{x,t n ) - ui(x,t n+ i)\. 

xeT N , t>0 x£T N 

Step 2. Use of the large time behavior result for single equations. The key idea is that for all 
n G N, the solutions of the scalar Hamilton-Jacobi equation (|5.4p have the large time behavior 
by (H3U). It follows that 

(5.7) $ n (., t) -»■ V n {.) in C(T N ) as t -»• 00 for some V n G BUC(T 7V ) 
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and V n is a solution of the equation ()1.4|) . 

Step 3. Derivation of the result for systems. From (15.6f) and (I5.7P we infer that (l^ n )n is a 
Cauchy sequence in BUC(T Ar ) and therefore 

(5.8) V n (.) -> V(.) in (7(1^) for some V G BUC(T iV ). 

By the stability result, V is also a solution of (|1.4j) . Using (|5.7p . we take limsup* with respect 
to £ both sides of (15.51) 

«?(x) < V n (x) + sup |itj(a;,£ n ) — u\(x,t n )\, for all i and x € T^. 

i=l,...,m, x£T N 

From (|5.8p . Lemma ll.3| let n tend to infinity in the above inequality. We obtain 

vii(x) < V(x) for all z and x € T^. 

Similarly, we get 

Ui(x) > V(x) for all i and x € T . 

Hence, we conclude iij(.,£) — > V(.) in C(T N ) as t tends to infinity for all i. □ 

Example 5.2. We show an example where the Hamiltonians satisfy the assumptions of 
Theorem 1 1 . 71 but not those of Theorems II. II and 15. 11 It means that all the results of Section [4j 
even in the case of a single equation, are not covered by [4]. Take 

H(x,p) = (2 + sin(p))|p| 2 + \p + l\ -1, peR. 

We check that H does not satisfies (|5.2p which is a key condition to prove Theorem 15.11 Since 



H is differentiable, (|5.2p reduces to 

(5.9) If H(p + q)>T] and H(q) < then H p (p + q)p - H(p + q) > tp(r)) > 0. 
Choose q = 0, we then rewrite the above requirement as 

H p (p)p - H(p) = p[2p(2 + sin(p)) + cos(p)|pj 2 ] - (2 + sm(p))\p\ 2 + 1 - |p + 1| + p(l - ^ ) 
Choose p n = 2n7r + ir, n > 0, then we have 

Hp(p n )p n - H(p n ) = 2p 2 n -pi~ p n , 

which tends to — oo as n — > +oo. This violates (|5.9p . In the same way, we can check that H 
also does not satisfy the key hypothesis (|1.7p of Theorem 11.11 

Proof of Lemma 11.31 This proof is a modified version of the one in [22] so that it can be 
adapted to general systems which is little more tricky. 
Step 1. Some first estimates. Thanks to (|1.34p . we have 

6 = min d ik (x) + Y] d jk (x)] > 0. 

x& jn ^=1,...,™, i C {l,...,m} f—i J 

where I contains j but not i. 

Set $(£) = max^- x ei N [ u i( x > — u j( a ')*)] — f° r each t > 0. Our purpose is to prove 
that $ is a subsolution to the equation 

(5.10) &(t) + 6$(t) = 0. 

Assume without loss of generality that $(£) = ui(xo, t) — U2(xo,t) and all functions are smooth 
to do a formal proof. It can be done rigorously by approximation techniques. 
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We have $'(*) = ^(x ,t) - ^(x ,t), Dui(x ,t) = Du 2 (x ,t). Subtracting two first 
equations in (jl.lj) . we have 

m m 

®'(t) + y^ J d 1 j(x )uj(x ,t) -y^d 2 j(x )uj(xo,t) = 0. 

3=1 3=1 

To obtain the conclusion, we only need to prove that 

m 

y~][dij(x ) - d 2 j(xo)]uj(x ,t) > S(ui(x ,t) -u 2 (x ,t)) 

3=1 

or 

m 

(5.11) (dn - d 2 \ - S)u\ > (d 22 - d\ 2 - 5)u 2 + / u (d 2 j - d\j)uj. 

3=3 

At the point (xo,t), we have 

m 

(5.12) u\ > u 3 , ...,u m > u 2 , d u - d 21 -5 = d 22 - d l2 - 5 + ^(d 2 j - dij) 
but the signs of d 2 j — d±j,j > 3 are unknown. 

Step 2. Separate the signs ofd 2 j — dij,j > 3 . We call J + is the set consists of all j € {3, ...,m} 
such that d 2 j — dij > and J~ := {3, ...,m} — J + . We rewrite (|5.1ip as 

(dn - d 2 i - 5)ui - (d 2 j — dij)uj > (d 22 - d\ 2 - 5)u 2 + V] (d 2 j - dy)uj 
jeJ+ jeJ- 

Actually, we can prove a stronger inequality 

(du - d 21 - 5)u\ - (d 2j - dij)ui > [d 22 - d 12 - 8)u 2 + (d 2j - d\j)u 2 

jeJ~ 

It is clear by ([5J2|) that 

dn -dai-S- ^2 ( d 2j - dij) = d 22 - d 12 - 5 + ^ (d 2j - dij) 
jeJ+ jeJ- 

From this equality and u\ > u 2 , we only need to prove that 

dn — d 2 i — 5 — ^2 (d 2 j - dij) > 0. 
jeJ+ 

This is true by the definition of 8. 

dn -<hi- ^2 ( d 2j - dij) = -[d 12 + d 2 i+ ^2 d 2j + ^2 - S - 

jeJ+ j&J+ j&J- 

Since $(0)e _<5t is a supersolution of (|5.10p with the initial value $(0), the comparison 
principle yields < §(t) < $(0)e _<5t for all t. Therefore, $(£) converges to as t — > oo. □ 
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6. Proof of the main result, Theorem 11.41 

As we said in the introduction, to prove Theorem 11.41 we perform a change of function 
which leads to a new system ()1.27|) . We start by giving a result for this auxiliary system, 
Theorem 16 .1| which is used to prove Theorem II. 41 We introduce the assumption 

(6.1) Wi(x, t) converges as t — I oo for alH = 1, . . . , m and x G /C, 

where K, is given in (|1.28|) . It is convenient to state this assumption here. But, under the 
conditions of Theorem 1 1.4| this assumption is automatically fulfilled (see Step 1 of the proof). 
For 7] > 0, we define 

(6.2) M Vii (t) = sup [wi(x,t) - Wi(x,s) - 2r](s - 1)]. 

x£T N , s>t 

We state the key estimate on this function 

Theorem 6.1. Consider system (jl.27p where the coupling D is independent of x and satisfies 
(fl~2l) and (fL33l) . Assume that F< G C{T N xix R N ), Wi G W 1 ' 00 ^ x (0,+oo)) and that 
fll.28|) . f)6. 1[) hold. Taking a sequence t n — > +oo suc/i t/iai (w(-,t n + -)) n converges uniformly 
to some function v G W 1 ' 00 ^ x [0,oo)) m . £>e/?ne 

(6.3) = sup s) - 2rj(s -t)]. 

x£l N , s>t 

Then 

(6.4) Pr),i(t) = for any i = 1, . . . ,m, i > and ?] > 0. 

We first give the proof of Theorem 11.41 under the set of assumptions (II. 25ft using Theo- 
rem 16.11 Then we prove Theorem 16.11 Notice that we skip the proof of Theorem 11.41 under 
(I1.26P for shortness since it can be deduced from the arguments under (jl.25p . 

Proof of Theorem ] l.J\ Step 1. Since the solution u of (ll.lj) is bounded, we can assume, by 
adding a big enough positive constant on the initial conditions if needed, that 

M > Ui(x, t) > 1, x 6 T N , t > 0, i = 1, . . . , m. 

Set 

(6.5) exp(uij(x, t)) = Ui(x, t) for all « = 1, . . . , m and (x, t) € T N x (0, oo). 
Then Wi G W l >°°(T N x (0, +oo)) for i = 1, . . . , m, solves (fl~2Tj) with 

Fi(x,w,p) = exp(-w)Hi(x,exp(w)p). 

We can check that Fi satisfies (I1.28D with K, := K where K is given in (jl.25p . Moreover, 
Lemma ESI gives the convergence of Uj(x,t), as t — > oo for all x G K. Thus (|6.ip is automat- 
ically satisfied from the way we define w^. 

Step 2. We apply Theorem 16. II to (jl.27p . By the stability result, the function v defined as 
in the statement of Theorem 16.11 is a viscosity solution of (I1.27P . By (I6.4p , 

Vi(x,t) — Vi(x,s) — 2r/(s — t)<0, for all i, s >t and x G T N . 

Letting rj tend to 0, we obtain 

Vi(x, t) — Vi(x, s) < 0, for all i, x G T^, s > t > 0. 

Step 3. The uniform convergence of (w(-,t n + -))n to v G W l ^{T N x [0,+oc)) yields 

— o n (l) + Vi(x, t) < Wi(x, t + t n ) < o n (l) + Vi(x, t) in x (0, oo), for all i. 
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Since V{ is nondecreasing in t, Vi(x,t) —¥ Vi QO (x) uniformly in x as t tends to infinity. Taking 
limsup* and lim inf* with respect to t both sides of the above estimate, we obtain 

— o n (l) + Vioo(x) < lim inf * Wi (x, t) < limsup* Wi(x,t) < o n (l) + Vioo(x) x € T^, for all i. 

t^+oo t-H-oo 

Letting n tend to infinity, we derive 

lim inf * Wi(x, t) = limsup * Wi(x, t) = Vioo(x), x € T N , for all i, 

which yields the uniform convergence of Wi(.,t) to Vioo in as t tends to infinity. 

Step 4- By stability, Vioo is a solution of (jl.27p . Therefore, Ui(.,t) = exp(wi(.,t)) converges 
uniformly, as t tends to infinity, to exp^oo) which is a solution of fjl .8|) with (ci, . . . , c m ) = 
under our assumption. It ends the proof of Theorem 11.41 □ 

Now, we turn to the proof of Theorem 16.11 

Proof of Theorem \6. 1[ Step 1. We notice that M^ j introduced in (|6.2p is nonnegative, bounded 
uniformly continuous thanks to the fact that Wi € W 1,oc (T N x (0, +oo)) for i = 1, . . . , m. We 
need the following result, the proof of which is postponed 

Lemma 6.2. Under the assumptions of Theorem \6.1\ 

(i) M^itt) defined by (I6.2p converges to the same limit for all i as t tends to infinity. An 
easy consequence of this fact is that Pn,i(t) = c(tj) where c{rj) depends only on r\. 

(ii) The P^^ 's attain their maximum at the same point (xt, St) for all i and 

(6.6) Pv^) = v i( x t,t) - Vi(x t ,s t ) - 2t](s t - t) 

= Pr]j(t) = Vj(xt,t) — Vj(xt,st) — 2rj(st — t) for all i,j = 1, . . . ,m and t > 0. 

Remark 6.3. Let us emphasize that Lemma 16.21 (ii) is the key idea to prove Theorem 11.41 
It is the rigorous expression of the idea which was explained in the Introduction (see (jl.29p ) 
to overcome the difficulty when passing from scalar equations to systems. 

To prove Lemma 16.21 we only need (|1.28p (z) and (|1.28p (u) is not used in that proof. The 
important condition (jl.28p (u) only plays a role in the proof of Theorem 16.11 

Step 2. Prom ()6.ip and the definition of Vi, we have 

(6.7) Vi(x, t) is independent of t for alH = 1, . . . , m and x E 1C. 

From Lemma I6.2( for any fixed r > 0, there exists x T , s T satisfying (I6.6p . We choose 
i G {1, . . . , m} such that 

(6.8) Vi(x T ,s T )= min Vj(x T ,s T ). 

j=l,...,m 

Let $ £ C 1 ((0, oo)) such that r is a strict maximum point of P„^ — $ in [r — 5, r + 6] for 
some 5 > 0. Since P^^i-) is constant, we have $'(t) = 0. To prove the theorem, we assume 
by contradiction that P„j(r) = c(jj) > 0. This fact and (|6.7p imply that 

(6.9) d(x T ,)C) > (3 V > 0, where x T satisfies (|6.6p with t = r. 

and K is defined in ([PHD . 

Step 3. Consider, x, y S T N , t £ [t — S, r + S\, s > t and the test function: 

¥' e {x, y, t, s) = vt(x, t) - Vi(y, s) - 2r/(s - t) - \x - x T \ 2 - \s - s T \ 2 - - 
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The function \& 4 ' e achieves its maximum over x x {(t,s)/t < s,t € [r — 6, r + 5]} at 
(x, y, t, s) because Vi is bounded continuous. We obtain some classical estimates when e — > 0: 

(6.10) < (x T , s T , r) since r is a strict maximum point of P rh i — $ , 

Vi(x,t) - Vi(y, s) > P v ,i(t), 
{ s > t since P^r) = c(?]) > 0. 

S"iep ^. Since u is the solution of (I1.27D . we can write the viscosity inequalities 

$'(£) - 2r] + Fi(x,Vi(x,t),p) + YJj=i dijexp(vj - Vi)(x,t) < 0, 
-2ry + Fi(y, Vi{y, s),p) + c^exp^- - s) > 0, 

where p = ^^-+2(x— x T ). Note that Vi is bounded Lipschitz continuous, then \Fi(x, Vi(y, s),p)- 
Pi(y, v i(y,s),p)\ — m(\x — y\) < O(e), thanks to the uniform continuity of Fi over compact 
subsets. It follows from (|6.10p . 

$'(*) - 2r] + Fi(x,Vi(x,t),p) + YJj=i dijexp(vj - Vi)(x,t) < 0, 
-2i] + Fi(x,Vi(y,s),p) + X^JLi dijexp^j - Vi)(x,s) + O(e) > 0. 

Step 5. From ([6.9p . we have 

(6.12) d{x, K) > for e small enough. 



(6.11) 



By (II. 2p . (16. 8j) and the fact that s — > s T: x — > x T as e — > 0, we have 

m 

^dijexp(vj - Ui)(jc,s) < O(e). 
3=1 

This gives 

Fi(x,Vi(y,s),p) > rj > for e small enough. 

Thanks to (|1.28j) (u) and the Lipschitz continuity of Pj with respect to w, we infer 

Fi(x,u,p) >7]>0, for all u > Vi(y,s), 
(Fi) w (x,u,p) > ^f(rj) > 0, for almost all u > Vi(y,s). 

Since Vi(x,t) > Vi(y,s), we obtain 

Fi(x,Vi(x,i),p) - Fi(x,Vi{y,s),p) > ^(r])(vi(x,i) - Vi{y,s)) > (^P^i). 

Step 6. We compute 

m m 

^ dijex.p(vj - Vi)(x, t) - dijexpfa - Vi)(x, s) 

3=1 3=1 

> ^2 -dijexp(vj - Vi)(x T , s T ){l - exp[P w -(r) - P»,,i(r)]} + O(e) 

> O(e), since P^i(.) = P,,j(-) = c(rf). 
Therefore, by subtracting both sides in (|6.1ip . we get 

^'(t) + ^(r ] )P nii (t) + 0(e) <0. 
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Using (|6.10p and the fact that $'(r) = 0. Letting e tend to 0, we obtain 
^(r/)c(rj) < 0, i.e. c(rj) < which is a contradiction. 

□ 

Proof of Lemma \6.1\ Proof of part (i) . We need 

Lemma 6.4. Under the assumptions of Theorem \6.1l N„ t i := exp(M„ i j) are subsolution of 
m 

(6.13) min{iV^ + ^ J d i j Pij {t)[N v>j (t) - N Vti (t)], N v4 - 1} < 0, i = 1, . ..,m, 
where pij are functions defined by 

f mi if Ni(t) > Nj(t), 
Pij[ ) ~ 1 m 2 ifNiWKNj®, 

for all i ^ j = 1, . . . ,m and t > 0, and mi < m2 are positive constants. 
Set N Vt i = exp(M r?i j) > 1. We show that (I6U31) will lead to 



Otherwise, we can assume that for i = 1, there is a function $ 6 C 1 (M) such that N„i — <3?(t) 
attains its maximum at some to > and, 

m 

^i^ + Y^duPijito^jito) - JV„,i(to)] > 0. 
i=2 

Prom (|6.13p . we have iV„ i(to) = 1 and hence to is a minimum point of $ since JV„ i > 1. 
Finally, we get 

m 

X^d y pi i (to)[JV w -(t O )-l]>0, 

J'=2 

this is a contradiction since dij < for j > 2. We then use the following lemma to conclude 

Lemma 6.5. Let Nj be bounded, positive continuous functions satisfying 

m 

(6.14) Ni + - ^i(t)] < 0, i = 1, . ,m, 

where D = {dij)\<ij< m satisfies (|1.2p and (jl.33p . p^- are functions defined by 

r iifNi{t)>Nj{t), 

W)- | 2tfN i (t)<N j (t), 

for all i ^ j = 1, . . . , m. T/ien A^(t) 's converge to the same limit as t tends to infinity. 

The proof of Lemma 16.51 is quite technical since we cannot deal directly with the discon- 
tinuity of the /Om's. The main idea of the proof is that we reorder the functions iVj's into 
the biggest function, the second biggest function, etc. and the smallest function( see Proof 
of Lemma 16.51 for details). Surprisingly, the new functions satisfy a nicer system where the 
discontinuous functions are replaced by constants. For this new system, we can prove 
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they converge to the same limit and, as a result, the old functions which are bounded by the 
biggest function and the smallest function must converge to the same limit. The proof of this 
Lemma will be given later. 

Finally, since wi — > Vi uniformly as t — > co, we easily obtain that P-q,i{t) = c(r]) for all i 
and i, where c(rj) depends only on rj. It completes the proof of part (i) of Lemma 16.21 

Proof of part (ii) of Lemma \6.2\ 

Step 1. Fix r > 0. If P„j(t) = 0, then we finish the proof since we can choose s T = r 
and any x T in (|6.6p to fulfill the requirement. We therefore assume that P^^r) > and let 

£ C 1 ((0, oo)) such that r is a strict maximum point of P„\ — <1? in [r — 6,T + 6] for some 
5 > 0. Since P r?j i(.) is a constant, ^'(t) = 0. Assume P^i^r) attains its maximum at x T , s T . 

Step 2. Consider, T N , t £ [r — <5, r + 5] and s > t the test function: 

I p 

^ 1,e (x,y,t,s) = vi(x,t) - vi(y,s) - 2r)(s - t) - \x - x T \ 2 - \s - s T \ 2 ^ 

Assume that \E rl ' e achieves its maximum over x x {(t,s)/t < s,t £ [r — 5, r + <5]} at 
(x,y,i,s). We obtain some classical estimates when e — > 0, 

(6.15) < (x, s, i) — > (x T , s t ,t) since r is a strict maximum point of P Vt \ — <3?, 

^ v\(x,t) —vi(y,s) > P v ^i(i), and s > t since P v ^(t) > 0. 

Step 3. Since v is the solution of (jl.27[) . we have 

&(t)-2r } + F 1 (x,v 1 (x,F),p) + Y,T=idi j exp(v j -v 1 )(x,t) < 0, 
-27/ + Fi(x,vi(y,s),p) +Y%Lidijex£>(.Vj -vi)(x,s) + 0(e) > 0. 

where p = . 

Step 4- Set Q?7j(t) := Vj(x T ,r) — Vj(x T , s T ) — 2r/(s r — r) for j 7^ 1, we have 

m m 

dyexp^j — Di)(x,t) — dijexp(uj — vi)(x, s) 

3=1 3=1 
in 

= ^2 ~dijexp(vj - vi)(x T ,s T ){l - exp[Q rhj (T) - P v ,i(t)]} + O(e). 
i=2 

Using (jl.28p (^) and the fact that v\(x, t) — vi(y,s) > P v ,i(t) > 0, we have 

Fi(x,Vi(x,F),p) - Fi(x,vi(y,s),p) > 0. 
Therefore, by subtracting both sides in (|6.16p . we get 

$'(*) + Yl - d ij e Mvj ~ vx)(x T ,s T ){l - exp[QvA T ) ~ p vA T )]} + °( e ) < °- 
3=2 

From (|6.15p . by letting e — >• 0, we obtain 

773 

-dij-exp(«j - «i)(z r ,s T ){l - exp[Q w -(r) - P„,i(r)]} < 0. 

Since —d\j > for j = 2, . . . , m and Q v j(t) < P^i(r), it follows from the above inequality 
that Qr),jij) = P„i(r), i.e., P^j's attain their maximum at the same point (x r ,s T ). □ 



(6.16) 
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Proof of Lemma \6.4\ We fix i € {1, . . . , m}. 

Step 1. Let $ £ C 1 ((0, oo)) and assume that r is a strict maximum point of M^i — over 
[r — 5, t + 5] for some 5 > 0. Everything will be done if M^^(t) = 0. We therefore assume 
that M vA (t) > 0. 

Step 2. Consider, x, y € T^, t G [r — 5, r + 5] and s > i the test function: 

I |2 

^• e (x, y, t, s) = Wi(x, t) - Wi {y, s) - 2r](s - t) - |X ~ 2/1 - 

Assume that achieves its maximum over x x {(t,s)/t < s,t € [r — 5, r + 5]} at 
(x, y, f, s). We obtain some classical estimates when e — > 0, 



(6.17) 



*^(x,y,f,s) -> M^(r) -$(r), ^f- -> 0, 

t — 7- r since r is a strict maximum point of M^i — $ in [r — 5, r + <5] , 
Wi(x,t) — Wi(y,s) > M V: i(F), s > i since M Vi i(r) > 0. 



Step 3. Since w is the solution of (jl.27|) . we have 

$'(t) —277 + Fi(x,Wi(x,t),p) + Yl 1 jLidijexp(wj - Wi)(x,t) < 0, 



-2r/ + Fi(x,Wi(y,s),p) + d ij exp(w j - Wi)(x,s) + O(e) > 0. 

where p = . 

S^ep ^. Using (jl.28p and the fact that Wi(x,t) > Wi(y,s) > M Vi i(t) > 0, we get 

Fi(x,Wi(x,t),p) - Fi(x,Wi(y,s),p) > 0. 

We compute 

m m 

y^ j d i jexp(wj - Wi)(x,t) - djjexp(wj - Wi)(x,s) 

> ^2 -dijexp(wj - Wi)(x, s){l - exp[M v j(r) - M^(r)]} + 0(e) 

> ^2 -dijPij(T){l - exp[M vJ (T) - M V)1 {t)]} + O(e). 
where we define for % ^ j 



Pij(t) : = 

with 



mi if 1 - exp[M vJ (t) - M Vji (t)] > 0, 
m 2 if 1 - exp[M vJ (t) - M V)i (t)\ < 0. 



mi = inf exp(w 7 - — Wi)(x, s) > 0, 

x£T N , s>0, l<i,j<m 

mi = sup exp(wj — Wi)(x, s) < oo 

x£T N , s>0, l<i,j<m. 

which are well-defined thanks to the boundedness of Wi. 
Therefore, by subtracting both sides in step 4 we get: 

$ '(*) + Yl -dijPij{r){l - exp[M vJ (T) - M^(t)]} + 0(e) < 0. 
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Using (|6.17p and letting e tend to 0, we obtain 

m 

+ -d ijPtJ {T){\ - expfM^r) - M^.(r)]} < 0, 

j=i> 

which is exactly the viscosity inequality for (|6. 13[) knowing M v> i(r) = exp[M^j(r)] > 1. □ 

Proof of Lemma [U75[ Step 1. In general, the discontinuity of pij causes a lot of problems but 
since we are in a nicer situation, we can replace pij by constants with the following technique. 
For each t, we define 

(6.18) Ri(t)= max N^t) := N h (t), 

iG{l,...,m} 

R 2 (t)= max Ni(t) := N i2 (t), 
ie{l,...,m}— {ii} 

R k (t)= max Ni(t) := N ik (t), k = 2,...,m. 

i£{l,...,m}-{ii,...,i k -i} 

Strictly speaking, we reorder the functions N^s such that the new functions satisfy a nicer 
system where the discontinuous functions p^ are replaced by constants. 
Step 2. Let us assume for a while that Ri satisfies 

m 

(6.19) R^(t)+J24 j R j (t)<0, i = l,...,m, 

where (^j)i<ij<m satisfies f)1.2|) and (jl.33p . This fact will be proven at the end of this proof. 
Step 3. Call Aj be the vector from Lemma [2TTT where the coupling now is (^j)i<ij<m- We 
have 

773 

Lemma 6.6. ((6l Lemma 5.5]) AjRj(t) is nonincreasing and converges as t — > +oo. 

i=i 

The idea of the proof of Lemma 16.61 was given in the proof of Lemma 12.81 From (I1.33P for 
(dL), there exists i 6 {1, . . . , m} and a > such that 

(6.20) d^ + aAj<0 j = 1, ... ,m, j ^ i. 
From (I6.19p . we obtain that Ri is a subsolution of 

R[{t) + (d' u + aki)Ri < aAA + ^(-d^Rj, t 6 (0, +oo). 

From the stability result ([HO [9]), Ri = lim sup t _>. +00 * Ri(t) is a subsolution of 

(6.21) (d'u + aAi)i?i < limsup* {aA^ + ^(-d-,-)^-}. 
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But, 

limsup* {aAiRi + ^{-d'^Rj} 



t— >+oo 

3+1 



in 



< a lim sup * A-jRj} + lim sup * {(— d'^ — aAj)Rj} 

3=1 3^* 
m 

< alimsup* {^^AjRj} + y~^(— d'^ — aAj)Rj, 

3=1 3^* 

since (|6.20p holds. The previous inequality and ()6.21[) imply 

m m 

u^AjRj = (d' u + aAi)Ri + y~)(djj + aAj)Rj < alimsup* A jRj}. 

3=1 

Using Lemma 16.61 it follows 



3=1 37^ 3=1 



(6.22) A i R j = limsup * AjRj} < ^ AjRj(t), t G (0, +oo). 



3=1 3=1 3=1 



Therefore, for all = 1, . . . , m, we have 



A k (R k (t) - R k ) > Y, A i R i 

j^k j+k 



Moreover 



MRk-Rk) = liminf * {A k (R k (t) - R k )} 

t— >+oo 

> liminf * {V AjRj - V AjRj(t)} > V AjRj - limsup * {V AjRj(t)} > 

t— !-+oo j—^^-qo 

Jytfe Jytfe J+k ]^k 

by (|6.22p . Since A k > 0, we conclude that R k < R k . 

Step 4- We finish with the proof of the claim (|6.19p . For simplicity, we assume first (|1.33p 
holds for all rows, i.e. dij ^ for all i,j = 1, . . . ,m, see the general case at the end of this 
proof. We assume without loss of generality that 

M 

(6.23) min — d^ = 1, max da = — . 

ij^j i=l, ...,m 2 

4-1- We first prove the claim for R\. Let io > and <p € C 1 (0, oo) such that R\ — <f> attains 
a maximum at to and suppose that R±(to) = N±(to)- Since Ni(to) > Nj(to), j > 2, then 
Pij(to) = 1, j > 2. Thus 

m m 

<p'(to) +J2~ di ^ Ri ^ + J2 di j N ^ t ^ - °' i - e -' 

3=2 3=2 

m m 

<f>'(t ) + (m - l)^i (to) - + Z^ 1 + d i3')[ iV 3'(*o) - fl i(*o)l ^ °" 

3=2 3=2 
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Using (ET231) and (flTTS]) . we have < 0, Nj^-R^to) <0, j> 2. The above inequality 

with the fact that Sj=2 ^Yf(*o) = S^=2 ^j'(*o) l ea d to 

m 

(6.24) 0'(* o ) + (m - l)2*i (*o) -J^-fto) < 0. 

J'=2 

^.U. We now prove the claim for 24, k > 2. Let to > and € C 1 (0, 00) such that R k — cf) 
attains a maximum at to- Suppose first that TVi(io) = R k (to) < R k -i(to)i so Ni(to) — </>(to) = 
24 (to) — (j>(to) > Ni(t) — 4>{t) for t near to- It follows from the definition of Pij(.) that 

m 

<P'(t ) +J2 d ^P^)i N j( t o) ~ R k(to)} < 0, i-e, 

J=2 



(6.25) 4! {to) +X) d y[ JV i(*o) " #k(*o)] + 2 ^ dij[iVj(*o) " 2? fc (t )] < 0, 

where X := {2 < j < m, R k {t ) > Nj(t )} and l c = {2, ... ,m}-l. Since iVi(t ) = 24(t ) < 
2?fe-i(to)) we obtain that card(Z c ) = k — 1. We have 

X)dij[#i(*o) " 2?fc(to)] = card(X)2? fc (t ) - ^iV^to) + J^ 1 + rf y)[#i(*o) " ^(*o)] 

J'GX jGZ JGX 

m 

> (m-k)R k (t ) -^Njito) = (m - k)R k (t ) - Yl fl i(*o)> 
jGX i=fc+i 

where the last inequality follows from the fact 1 + dij < and iV,-(fo) — 24 (to) < 0, j 6 X. 
Noticing that card(Z c ) = — 1, we have 

2^ci lj [iV J (to)-2? fc (to)] 
= M(k - l)R k (t ) -MJ2 Nj(t ) + J2( M + 2dijWj(t ) - R k (t )} 

k-l 

> M(k - 1)24 (to) -MJ2 Nj(t ) = M(k - 1)24 (to) - M^^(t ), 

jS2 c j=l 

where the inequality follows from the fact M + 2d±j > and Nj(to) — 24 (to) > 0, j € X c . 
Using these two above inequalities, it follows from (|6.25j) that 

fe— 1 m 

(6.26) 0'(t o ) + [M(/c-l)+m-A:] J R fc (to)-M^ J R i (to)- 24(t ) < 0. 

It remains to deal with the case N\{to) = 24 (to) = 24-i(to)- We divide it into two subcases 
4.3. If iVi(to) = 24(to) = Rk-ifo) = - = 2?/(t ) < Ri-i(t ) with k - 1 > I > 2, then 
2Vi(t ) - 0(to) = 2*z(t ) - <H*o) > 2Vi(t) - 0(t). Applying the result in (J6J26]), we have 

i— 1 m 

0'(t o ) + [M(Z - 1) +m - l]Ri(t ) - M^Rj(to) - ^ Rj(t ) < 0. 

j=i j=i+i 
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It is easy to see that 

k— 1 m 

[M{k-l)+m-k]R k (t )-MY,Rj(to)- J2 

j=l j=k+l 
l—l m 

< [Mil-^+m-l^i^-Mj^RM- 

j=l j=l+l 

It follows that (|6.26p holds in this case too. 

4-4- If Ni(to) = Rk(to) = Ri(to), then we have the estimate (|6.24p . It is easy to see that 

ft— 1 m 

[M(k-l)+m-k]R k (t )-Mj2Rj(to)- R ^ 

3=1 j=k+l 

in 

< [m-^R^-J^Rjito). 

3=2 

Then (jQ6|) holds. 

Step 5. If (jl.33p only holds for a row, we will take the minimum in (|6.23p among the djj's 
which are nonzero and we keep zero elements of the coupling. Proceeding in a similar way as 
above, we obtain a new coupling satisfying f)1.2|) and (jl.33p . □ 



7. Proof of Theorem 11.51 

We give briefly the proof of Theorem 11.51 which is based on the ideas used in the proof of 
Theorem II .41 If we can find a C 1 subsolution of system (jl.8p . we can prove easily Theorem 1 1.5 1 
as it was done in the Introduction. The existence of C 1 subsolutions of stationary equations is 
established in Fathi-Siconolfi [13] under quite general conditions. We think that the existence 
of C 1 subsolutions of system (jl.8p is still true under similar conditions as in [13] but it is 
beyond the scope of this work. Now, we prove Theorem 1 1 . 5 1 using another approach. 

Proof of Theorem \1.5l general case. Step 1. Approximation C 1 subsolution. Fix a Lipschitz 
solution V of (jl.8p such that U{ — Vi > 2 where u is the solution of (jl.ip . The existence of 
V is given by Theorem 12.21 Using |13| Theorem 8.1] we can find, for all 8 > 0, a function 
V s € C l {T N ) m such that 

m 

(7.1) H t (x,DVf) + ^2d ij (x)Vf < 5, x E T N , i = l,...,m 

3=1 

\\Vf — Vi\\oo < 8. 

where we assumed the ergodic constant is (0, . . . , 0) for simplicity. The existence V s is ob- 
tained by the convolution of V with a standard regularized function. It is worth noticing that 
the convolution of V with a regularized function is still a periodic function. 
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Step 2. Change of function. Similarly as in the proof of Theorem 11.41 we make the change of 
function ex.p(wf) = Ui — Vf . The function w s is solution to the new system 

(7.2) M + F f {Xi w l Dwf) + f; di jeX p(vj - wf) 

3=1 

m 

+ exp(-i4)[Hi(x, DVf) + dijVj] = 0. 

3=1 

with Ff(x,w,p) = ex.p(—w)Hi(x,exp(w)p + DVf) — exp(—w)Hi(x,DVf). We can check Ff 
satisfies (|1.28p with /C = 0. Moreover, the term *$>(n) appearing in (jl.28p can be chosen to 
be independent of 5. The proof relies on the upper semicontinuity of the subdifferentials of 
convex functions and the strict convexity of the Hamiltonians. The concrete computation is 
left to the reader. 
Step 3. For r/ > 0, we define 

(7.3) M« fi (t) = sup [wf(x,t)-w s i (x : s)-27 ] (s-t)}, 

x£l N , s>t 

M v ,i(t) = sup [wi(x,t) — Wi(x, s) — 2n(s — t)], where exp(wj) = ui — V%. 

xGT N , s>t 

Repeat the proof Lemma 16.41 we easily have := exp(M^) are subsolution of 

m 

(7.4) min{iVj + £ d iiP % (t) [N^ (t) - N^t)} - 8, < 4 - 1} < 0, i = 1, . . . ,m, 
where pfj is defined by 



5 f mi i£N?(t)>N*(t), 



m 2 if iVf (i) < iV/(t), for all i 7^ j = 1, . . . , m and t > 0, 
and mi < ^2 are positive constants which are independent of 5. 

Remark 7.1. In fact, following the proof of Lemma [6.41 we see that the only difference is the 
appearance of the term A := [exp(— wf (x, i)) — exp(—wf(y, s))][Hi(x, DVf) + YlJLi dijV?(x)] 
when subtracting both sides in Step 4 as in the proof of Lemma 16.41 Thanks to the fact that 
wf(x,i) > wf(y,s) and (|7.ip . we have 

m 

-1 < exp(-u;£(x,t)) - exp(-wf(y, s)) < and Hi(x, DVf) + ^ d i:j Vf(x) < 5. 

3=1 

This implies easily that A > —5. It explains the occurrence of the term 5 in (|7.4D . 

Since — > N Vi i := exp(M r?j j) as 5 —> 0, by the stability result for viscosity solutions, we 
can show that N^i solves 

m 

(7.5) min{N^ + diiPH^Wv^) - N^t)], N nA - 1} < 0, % = 1, . . . ,m, 
where pij is defined by 

/ mi if Ni(t) >Nj(t), 
Pl] y > \ m 2 if Ni(t) < Nj(t), for all i ^ j = 1, . . . , m and t > 0. 
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Hence thanks to Lemma 16.51 we obtain that N Vi i(t) converges to the same limit for all i as t 
tends to infinity. 

Step 4- Taking a sequence t n — > +oo such that (u(-,t n + -)) n converges uniformly to some 
function in W 1 ' 00 ^ x [0,oo)) m . Thus (w s (-,t n + ■))„ -> v s G W^°°(T N x [0,oo)) m for all 
6 > 0, and (w(-,t n + •))« ->■ u G W 1 ' 00 ^ x [0,oc)) m . It is clear that v s —> v uniformly as 
5 —> 0. Define 

(7.6) P^(t) = sup K 5 (x,t)-^(x, S )-2r ? ( S -t)], 

X£T N , 8>t 

P n ,i{t) = sup [vi(x,t) - Vi(x,s) - 2r](s - t)]. 

x£T N , s>t 

Since N v ^(t) converges to the same limit, we easily obtain that Pn,i(t) = c(rj) for all t > 
and i = 1, . . . , m. Moreover 

Lemma 7.2. Under the assumptions of Theorem I i . 51 

(z) TTie P^j 's attain their maximum at the same point for all i, see part {ii) of Lemma 1 6. 2\ 
for the exact definition. 

(ii) Pn,i{p) = for any % = 1, . . . , m, t > and rj > 0. 

We then repeat readily the proof of Theorem 1 1.41 to obtain the convergence as desired. □ 
We end this section with the proof of Lemma 17.21 
Proof of Lemma \7.2\ Proof of part (i) of Lemma \7.2\ 

Step 1. Fix t > 0. If P„j(t) = 0, then we finish the proof since we can choose s T = r and any 
x T to fulfill the requirement. We therefore assume that P v ,i(t) > and let $ G C^^oo)) 
such that r is a strict maximum point of P Vt i — <I> in [r — ro, r + ro] for some ro > 0. Since 
Pr),i(-) is a constant, $'(r) = 0. 

Step 2. Assume P^.i(r) attains its maximum at x T , s T . Consider, x,y G T ,t G [r — ro, r + ro] 
and s > t the test function: 

I |2 

^' e (x, y, t, s) = v((x, t) - v((y, s) - 2r](s - t) - \x - x T \ 2 - \s - s T \ 2 - |X ~J l - $(t). 

The function 1 I /1 ' <E achieves its maximum over x x {(i, s)/t < s,t E [t — ro, r + ro]} at 
(x,y,i,s). We obtain some classical estimates, 

{^=|£ -»■ when e ->• 0, 
lim,5_ i ,oh m €-i>o(^) t) = (x T , s T , r) since r is a strict maximum point of P V: i — <£, 
vf(x,t) > vf(y,s), s > t for e, 5 are small enough since P^i(r) > 0. 

5"iep 5. Since v s is the solution of (I7.2p . we have 

f7 81 / $ ' ( ^ " 2r? + ^ + ^T=i dijeMvj ~ t) + a(x) < 0, 

[ ' ' I -2r ? + F 1 5 (x,^(y,s),p) + E7 = i^iiexp(^-7;f)(x,s) + 0(e) + a(y) > 0. 

with p = + 2(x — x r ) and 

m 

a(x) := exp(-^(x,i))[Hi(x,DVf) +J2d ij Vf(x)], 

m 

a(jj) := exp(-«f(y, s))[^(x, DVf) + ]T c^/(x)]. 
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Step 4- Repeating Step 4 of the proof of Lemma 16.21 with taking Remark 17.11 into account. 
Letting e tend to and then 5 to 0, we get 

m 

^2 -dijexp(vj - v 1 )(x t ,t){1 -exp^jfr) - P v ,i(t)}} < 0. 

3=2 

where Qrj,j(T) '■= Vj(x T ,r) — Vj(x T ,s T ) — 2r](s T — r). Since —d\j > for j = 2, . . . ,m and 
Q-n,j{ T ) < Pr},iij)i it follows from the above inequality that Q v j(t) = Pti,i(t), i.e., the Prj/s 
attain their maximum at the same point (x T ,s T ). 



Proof of part (ii) of Lemma \7.2 



Step 5. For any fixed r > 0, there exists (x T , s T ) satisfying part (i), i.e., (x T , s T ) is the common 
minimum point of the -P^j^'s. Hence we can choose i S {1, . . . , m} such that 

(7.9) Vi(x T ,s T )= min Vj(x T ,s T ). 

j=l,...,m 

Assume that i = 1 and then repeat readily Steps 1,2,3. From (jl.2p . (|7.9p and the fact that 
lim 5 ^ lime^o(x,,s) = (x T ,s T ), we get 

in 

dijexp(vj — v\)(x, s) < 0(e) + 0(8). 

This gives 

Ff(x,vf(y,s),p) > i]/2 > for e, 5 are small enough. 
From (fTTj) and (fL28]) (u). we obtain 

> V(ri)(vt(x,i)-4(V,5))- 
Let us recall that ^(r/) can be chosen to be independent of S as mentioned in Step 2 of the 
proof of Theorem 11.51 

Step 6. As Step 6 in the proof of Theorem 16-H we have 

m m 

dijexpiv* - vf)(x, t)~Y^ dijeMv* ~ 4){x, s) > 0(e) + 0(5). 

3=1 3=1 

Therefore, by subtracting both sides in (j7.8H and taking Remark 17.11 into account, we get 
$'(t) + ^(^((x, t) - v((y, s)) + 0(e) + 0(5) < 0. 

Letting e tend to and then 5 to 0, noting that 3?'(t) = 0, we obtain 
^(rj)c(rj) < 0, i.e. c(rj) < which is a contradiction. 

□ 

8. Appendix 

For the reader's convenience, we give a formal link between optimal control of hybrid 
systems with pathwise deterministic trajectories with random switching and Hamilton-Jacobi 
systems with convex Hamiltonians. 

Consider the controlled random evolution process (At,fj) with dynamics 



.1) 



X t = b Vt (X u at), t>0, 

(X ,vo) = (x,i)£T N x {l,...,m}, 
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where the control law a : [0, oo) — > A is a measurable function (^4 is a subset of some metric 
space), hi € L°°(T N x A;R N ), satisfies 

(8.2) \bi(x,a)-bi(y,a)\<C\x-y\, x,y e T N , a e A, 1 < i < m. 

For every at and matrix of probability transition G = (^ij)i.j satisfying Y2j^i"fij = 1 f° r 
i 7^ j and 7^ = —1, there exists a solution (Xt,ut), where X t : [0, 00) — > T N is piecewise 
C 1 and z^(i) is a continuous-time Markov chain with state space {1, . . . ,m} and probability 
transitions given by 

P{ft+At = 3 I ft = »} = lij At + o(Ai) 

for j ^ i. 

We introduce the value functions of the optimal control problems 

(8.3) Ui(x,t) = inf E x j{/ £ Vs (X 8 , a s )ds + u 0Mt (X t )}, i = l,...m, 

a t €L°°([0,t],A) J 

where E x j denote the expectation of a trajectory starting at x in the mode i, and the functions 
u ,i :T N ^R, ii :T N x A are continuous. 

It is possible to show that the following dynamic programming principle holds: 

Ui(x,t) = inf E xi { / £ Us (X s ,a s )ds + u l/ (X h ,t - h)} 0<h<t. 

a t eL°°({0,t],A) Jo 

Then the functions U{ satisfy the system 

~ttt~ + sup[-(bi(x,a),Dui) -£i(x,a)] + } J Jjj(u i - uj) = (x,t) £ T N x (0, +00), 

aGA ^. i = 1, ■ ■ ■ m, 

Ui(x,0) = u ,i(x) x € T^, 

which has the form (jl.ip by setting Hi(x,p) = sup ag ^[— (bi(x, a),p) — £i(x, a)] and da = 
Y.j+i Uj = 1 and dij = -jij for j / i. 

Remark 8.1. 

(i) Assume £i(x,a) = fi(x) where the /j's satisfy (ll.40p . If the following controllability 
assumption is satisfied: for every i, there exists r > such that for any x € T , the ball 
B(0, r) is contained in co{6j(x, ^4)}. Then, Theorem 11.61 holds. Roughly speaking, it means 
that the optimal strategy is to drive the trajectories towards a point x* of S and then not to 
move anymore (except maybe a small time before t). This is suggested by the fact that all 
the fi's attain their minimum at x* and, at such point, the running cost is smallest. 

(ii) It is also possible to consider differential games with random switchings to encompass 
system (jl.ip with nonconvex Hamiltonians. 

(iii) More rigorous dynamical interpretations of system (jl.ip are given in |23| . 
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